Wearable glasses and method of providing content using the same

ABSTRACT

A wearable glasses is provided. The wearable glasses includes a sensing circuit, a communication interface, a display, a memory and one or more processors. The sensing circuit senses movement information of a user wearing the wearable glasses. The communication interface receives notification message information. The display displays the notification message information within an angle of view of the user wearing the wearable glasses. The memory and one or more processors execute one or more programs including instructions to obtain environment information, determine a movement state of the user based on the sensed movement information of the user and the environment information, and control the display to display the received notification message information according to the movement state of the user.

CROSS-REFERENCES TO RELATED APPLICATION

This application is a continuation application of U.S. application Ser.No. 16/026,071 filed Jul. 3, 2018, which is a continuation applicationof U.S. patent application Ser. No. 14/815,082, filed Jul. 31, 2015, nowU.S. Pat. No. 10,037,084, issued Jul. 31, 2018, which claims the benefitof Korean Patent Application No. 10-2014-0098626, filed on Jul. 31,2014, and Korean Patent Application No. 10-2015-0043300, filed on Mar.27, 2015, in the Korean Intellectual Property Office, the disclosures ofeach of which are incorporated by reference herein in their entireties.

BACKGROUND 1. Field

Apparatuses, methods, and articles of manufacture consistent with thepresent disclosure relate to a wearable glasses and a method ofproviding content corresponding to a notification event via the wearableglasses.

2. Description of the Related Art

A wearable device is a device that a person can wear. As wearabledevices have been actively developed, various types of thereof have beenreleased or are expected to be released on the market. Examples of suchwearable devices are wearable watches, wearable glasses, and wearablebelts.

Wearable glasses can be worn like typical eyeglasses and provide a userwith various information. While wearable glasses allow a user to usehis/her hands freely, the view of the user may be obstructed byinformation displayed on the wearable glasses.

SUMMARY

According to an aspect of one or more exemplary embodiments, there isprovided a wearable glasses comprising a sensing circuit configured tosense movement information of a user wearing the wearable glasses; acommunication interface configured to receive notification messageinformation; a display configured to display the notification messageinformation within an angle of view of the user wearing the wearableglasses; and a controller configured to determine a movement state ofthe user based on the sensed movement information of the user andcontrol the display to display the received notification messageinformation according to the movement state of the user.

The controller may be further configured to determine whether the useris wearing the wearable glasses by using at least one sensor included inthe sensing circuit, and control the sensing circuit to sense a movementof the user when it is determined that the user is wearing the wearableglasses.

The controller may be further configured to determine the movement stateof the user by using at least one of acceleration information, tiltinformation, biometric information, altitude information, atmosphericpressure information, eyeball tracking information, and positioninformation measured by the sensing circuit.

The controller may be further configured to determine the movement stateof the user using movement information of the user received from anexternal device.

The controller may be further configured to determine a time to displaythe notification message information based on the movement state of theuser and control the display to display the notification messageinformation at the determined time.

The controller may be further configured to output the notificationmessage information at a present time when a movement speed of the useris less than a threshold speed, and when the movement speed of the useris equal to or greater than the threshold speed, the controller may befurther configured to determine to output the notification messageinformation at a different time than the present time.

The different time may comprise at least one of a point of time when auser input for requesting to output the notification message informationis received, a point of time when a movement state of the user ischanged, and a point of time when a preset time has passed.

The controller may be further configured to determine a display form fordisplaying the notification message information based on a movementstate of the user and control the display to display the notificationmessage information according to the determined display form.

When a movement speed of the user is equal to or greater than athreshold speed, the controller may be further configured to display aportion of the notification message information, and when a movementspeed of the user is less than the threshold speed, the controller maybe further configured to display an entirety of the notification messageinformation.

The controller may be further configured to determine at least one of anaudio signal and a video signal as an output form of the notificationmessage information according to environment information about anenvironment within a certain distance from the wearable glasses.

The environment information may include at least one of informationabout external sounds generated within the certain distance from thewearable glasses and information about an external image obtained byusing an image sensor.

According to another aspect of one or more exemplary embodiments, thereis provided a wearable glasses comprising a sensing circuit configuredto sense a movement of a user and output a signal; a communicationinterface configured to receive notification message information; adisplay configured to display the notification message information; anda controller configured to control the display to display the receivednotification message information based on the signal output from thesensing circuit.

The controller may be further configured to determine whether the useris wearing the wearable glasses based on a signal output from at leastone sensor included in the sensing circuit, and when it is determinedthat the user is wearing the wearable glasses, the controller may befurther configured to control the sensing circuit to sense a movement ofthe user.

According to yet another aspect of one or more exemplary embodiments,there is provided a method of providing information, wherein the methodis performed by a wearable glasses and comprises receiving notificationmessage information; sensing movement information of a user wearing thewearable glasses; determining a movement state of the user by usingsensed movement information of the user; and displaying the receivednotification message information according to the movement state of theuser.

The sensing of movement information of the user may comprise determiningwhether the user is wearing the wearable glasses by using at least onesensor included in the wearable glasses; and sensing the movementinformation of the user when it is determined that the user is wearingthe wearable glasses.

The displaying of the received notification message information maycomprise determining a time to display the notification messageinformation; and displaying the notification message information at thedetermined time.

The determining a time to display the notification message informationmay comprise determining to output the notification message informationat a present time when a movement speed of the user is less than athreshold speed and to output the notification message information at adifferent time than the present time when the movement speed of the useris equal to or greater than the threshold speed.

The displaying of the received notification message information maycomprise determining a display form for displaying the notificationmessage information; and displaying the notification message informationaccording to the determined display form.

The determining of the display form may comprise determining to output aportion of the notification message information when a movement speed ofthe user is equal to or greater than a threshold speed and to output anentirety of the notification message information when a movement speedof the user is less than the threshold speed.

The determining of the display form may comprise obtaining environmentinformation about an environment within a certain distance from thewearable glasses; and determining to provide the notification messageinformation in the form of at least one of an audio signal and a videosignal according to the obtained environment information.

The wearable glasses may comprise wearable glasses.

According to yet another aspect of one or more exemplary embodiments,there is provided a wearable glasses comprising a sensor configured tosense movement information of a user wearing the wearable glasses; and acontroller configured to determine a movement state of the user based onthe sensed movement information and control a display to display anentirety of the received notification message when the movement stateindicates the user is in a safe condition, none of the receivednotification message when the movement state indicates that the user isin a dangerous situation, and a portion of the received notificationmessage when the movement state indicates that the user is in neitherthe safe condition nor the dangerous situation.

When the movement state indicates that the user is in the dangeroussituation, the controller may store the received notification messagefor display at different time than a present time.

When the movement state indicates that the user is in the dangeroussituation, the controller may control the display to display thereceived notification information when the movement state indicates thatthe user is no longer in the dangerous situation.

The sensor may be one or more of an acceleration sensor, a tilt sensor,a biometric information sensor, an altitude sensor, an atmosphericpressure sensor, an eyeball tracking sensor, and a position sensor.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects will become apparent and more readilyappreciated from the following description of the exemplary embodiments,taken in conjunction with the accompanying drawings in which:

FIG. 1 illustrates a diagram for describing a method of operating awearable glasses according to an exemplary embodiment;

FIGS. 2 and 3 illustrate diagrams for describing an external appearanceof a wearable glasses according to exemplary embodiments;

FIG. 4 illustrates a diagram for describing a notification systemaccording to an exemplary embodiment;

FIG. 5A illustrates a flowchart of a method used by a wearable glassesto provide content based on movement information of a user, according toan exemplary embodiment;

FIGS. 5B and 5C illustrate diagrams for describing a method used by awearable glasses to determine a movement state of a user based onmovement information of the user, according to an exemplary embodiment;

FIG. 6 illustrate a flowchart of a method used by a wearable glasses toprovide content corresponding to a notification event based on whether auser is wearing a wearable glasses or not, according to an exemplaryembodiment;

FIG. 7 illustrates a flowchart of a method used by a wearable glasses todetect an occurrence of a notification event, according to an exemplaryembodiment;

FIG. 8 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving a notification messagefrom a server, according to an exemplary embodiment;

FIG. 9 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving a schedule notificationmessage from a mobile terminal, according to an exemplary embodiment;

FIG. 10 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving a text message via amobile terminal according to an exemplary embodiment;

FIG. 11 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving advertisement contentaccording to an exemplary embodiment;

FIG. 12 illustrates a flowchart of a method used by a wearable glassesto obtain movement information of a user, according to an exemplaryembodiment;

FIG. 13 illustrates a flowchart of a method used by a wearable glassesto obtain movement information of a user from an external device,according to an exemplary embodiment;

FIG. 14 illustrates a flowchart of a method used by a wearable glassesto determine a time to output content corresponding to a notificationevent based on a movement speed of a user, according to an exemplaryembodiment;

FIGS. 15A and 15B illustrate diagrams for describing an example ofadjusting, by a wearable glasses, a time and a method to output contentcorresponding to an notification event based on a movement speed of auser, according to an exemplary embodiment;

FIG. 16 illustrates a flowchart of a method of determining an outputform of content corresponding to a notification event based on movementinformation of a user, according to an exemplary embodiment;

FIGS. 17 through 19 illustrate diagrams for describing an example ofproviding, by a wearable glasses, a portion of content or entire contentcorresponding to an notification event based on a movement speed of auser, according to an exemplary embodiment;

FIG. 20 illustrates a flowchart of a method used by a wearable glassesto output non-output content when an event has occurred, according to anexemplary embodiment;

FIG. 21 illustrates an example of outputting, by a wearable glasses,content corresponding to a previously generated notification event basedon a movement change event of a user, according to an exemplaryembodiment;

FIG. 22 illustrates a diagram for describing a method used by a wearableglasses that changes an output form of content based on a certain inputby a user, according to an exemplary embodiment;

FIGS. 23 and 24 illustrate diagrams for describing an example ofoutputting, by a wearable glasses, entire content based on a head upmotion of a user;

FIG. 25 illustrates a diagram for describing an example of blocking, bya wearable glasses which has output a portion of content, output of thecontent based on a user input, according to an exemplary embodiment;

FIG. 26 illustrates a flowchart of a method used by a wearable glassesto highlight a keyword in content corresponding to an event, accordingto an exemplary embodiment;

FIG. 27 illustrates a diagram for describing an example of highlighting,by a wearable glasses, a keyword in content based on movementinformation of a user, according to an exemplary embodiment;

FIG. 28 illustrates a flowchart of a method used by a wearable glassesto adjust a transparency of content corresponding to an event, accordingto an exemplary embodiment;

FIG. 29 illustrates a diagram illustrating an example of adjusting, by awearable glasses, a transparency of content based on speed informationof a user when the user is driving, according to an exemplaryembodiment;

FIG. 30 illustrates a diagram for describing a method used by a wearableglasses to determine a form of an output signal based on environmentinformation, according to an exemplary embodiment;

FIGS. 31 and 32 illustrate diagrams illustrating an example ofadjusting, by a wearable glasses, a form of an output signal based onexternal sound information, according to an exemplary embodiment;

FIG. 33 illustrates a flowchart of a method used by a wearable glassesto determine an output form of content corresponding to a notificationevent based on external image information, according to an exemplaryembodiment;

FIG. 34 illustrates an example of adjusting, by a wearable glasses, aform of an output signal based on external image information, accordingto an exemplary embodiment;

FIG. 35 illustrates a flowchart of a method used by a wearable glassesto determine whether to output notification content based on variationinformation of an external image, according to an exemplary embodiment;

FIG. 36 illustrates an example of changing, by a wearable glasses, anoutput form of content corresponding to a notification event based onvariation information of an external image, according to an exemplaryembodiment;

FIG. 37 illustrates a flowchart of a method used by a wearable glassesto adjust at least one of a transparency, a color, and a chroma ofcontent corresponding to a notification event based on external imageinformation, according to an exemplary embodiment;

FIG. 38 illustrates a diagram for describing an example of adjusting, bya wearable glasses, a color of content corresponding to a notificationevent based on external image information, according to an exemplaryembodiment;

FIG. 39 illustrates a flowchart of a method of a wearable glassesdetermining an output position of content corresponding to anotification event, according to an exemplary embodiment;

FIG. 40 illustrates a diagram for describing an example of changing, bya wearable glasses, an output position of content corresponding to anotification event, according to an exemplary embodiment;

FIG. 41 illustrates a flowchart of a method used by a wearable glassesto determine a method of providing content corresponding to an eventbased on setting information of a user, according to an exemplaryembodiment;

FIG. 42 illustrates an example of setting information related to outputof content corresponding to an event, according to an exemplaryembodiment;

FIGS. 43 and 44 illustrate an example of outputting, by a wearableglasses, content corresponding to a notification event based on settinginformation of a user, according to an exemplary embodiment;

FIG. 45 illustrates a flowchart of a method used by a wearable glassesto receive emergency notification information from an external wearabledevice, according to an exemplary embodiment;

FIG. 46 illustrates an example of displaying, by a wearable glassespulse rate information received from an external wearable device,according to an exemplary embodiment;

FIG. 47 illustrates a flowchart of a method used by a wearable glassesto output content corresponding to a notification event via an externaldevice, according to an exemplary embodiment;

FIG. 48 illustrates an example of outputting, by a wearable glasses,content corresponding to a notification event based on a user input,according to an exemplary embodiment;

FIG. 49 illustrates a flowchart of a method used by a wearable glassesto transmit content corresponding to a notification event in response toa request by an external device, according to an exemplary embodiment;

FIG. 50 illustrates an example of displaying, by an external device,content corresponding to a notification event based on a user inputreceived via the external device, wherein the external device isconnected to a wearable glasses;

FIG. 51 illustrates a flowchart of a method used by a wearable glassesto output content corresponding to a notification event based onmovement information of a user, according to an exemplary embodiment;

FIG. 52 illustrates an example of outputting, by a wearable glasses,content corresponding to a notification event based on movementinformation of a user, according to an exemplary embodiment;

FIG. 53 illustrates a flowchart of a method used by a wearable glassesto provide a list of non-output contents, according to an exemplaryembodiment;

FIG. 54 illustrates an example of providing, by a wearable glasses, alist of non-output contents based on a certain user input, according toan exemplary embodiment;

FIG. 55 illustrates an example of providing, by a wearable deviceconnected to a wearable glasses, a list of contents that are not yetoutput from the wearable glasses, according to an exemplary embodiment;

FIG. 56 illustrates an example of providing, by a wearable deviceconnected to a wearable glasses, a list of contents that have beenpreviously output from the wearable glasses, according to an exemplaryembodiment; and

FIGS. 57 and 58 are block diagrams illustrating a structure of awearable glasses according to an exemplary embodiment.

DETAILED DESCRIPTION

Terms used herein will now be briefly described, and then exemplaryembodiments will be described in detail.

All terms including descriptive or technical terms which are used hereinshould be construed as having meanings that are understood to one ofordinary skill in the art. However, the terms may have differentmeanings according to an intention of one of ordinary skill in the art,precedent cases, or the appearance of new technologies. Also, some termsmay be selected by the applicant, and in this case, the meaning of theselected terms will be described in detail in the detailed description.Thus, the terms used herein have to be defined based on the meaning ofthe terms together with the description throughout the specification.

Also, when a part “includes” or “comprises” an element, unless there isa particular description contrary thereto, the part may further includeother elements, not excluding the other elements. In the followingdescription, terms such as “unit” and “module” indicate a unit forprocessing at least one function or operation, wherein the unit and theblock may be embodied as hardware or software, or may be embodied bycombining hardware and software.

Exemplary embodiments will now be described more fully with reference tothe accompanying drawings. However, the exemplary embodiments may beembodied in many different forms, and should not be construed as beinglimited to the exemplary embodiments set forth herein; rather, theseexemplary embodiments are provided so that this disclosure will bethorough and complete, and will fully convey the concept of the one ormore exemplary embodiments to those of ordinary skill in the art. In thefollowing description, well-known functions or constructions are notdescribed in detail because they would obscure the exemplary embodimentswith unnecessary detail, and like reference numerals in the drawingsdenote like or similar elements throughout the specification.

As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items. Expressions such as “atleast one of,” when preceding a list of elements, modify the entire listof elements and do not modify the individual elements of the list.

FIG. 1 illustrates a diagram for describing a method of operating awearable glasses according to an exemplary embodiment.

According to an exemplary embodiment, the wearable glasses 100 is adisplay apparatus that is worn on a user's head to provide an image infront of the eyes of the user. The inventive concept is not limited toglasses-type wearable devices (e.g., the wearable glasses 100), but isalso applicable to a head mounted display (HMD) apparatus, a portion ofa main body of which is fixed to the head of a user so as to displayinformation within an angle of view of the user.

According to an exemplary embodiment, the HMD apparatus may beimplemented in various forms. For example, the HMD apparatus may beimplemented as eyeglasses, a helmet, and a hat, but is not limitedthereto.

According to an exemplary embodiment, the wearable glasses 100 mayprovide content 10 corresponding to a notification event. In the presentspecification, content providing may include, for example, displayingcontent, replaying content, or outputting content.

In the present specification, a notification event may refer to an eventat which information to be sent to a user is generated. A notificationevent may be, for example, an event for notifying the user of asituation that occurs in the wearable glasses 100 or outside thewearable glasses 100.

For example, a notification event may include at least one of a schedulenotification event, a tourist event, a traffic information notificationevent, an advertisement notification event, an update notificationevent, a recommended content notification event, a health informationnotification event, and an emergency notification event, but is notlimited thereto.

In the present specification, ‘content corresponding to a notificationevent’ may refer to content that is generated to be sent to a user.‘Content corresponding to a notification event’ may be generated in thewearable glasses 100 or may be obtained from the outside of the wearableglasses 100. For example, when a notification event has occurred, thewearable glasses 100 may generate content 10 corresponding to thenotification event. Also, the wearable glasses 100 may receive contentcorresponding to a notification event from an external device or aserver. Hereinafter, ‘content corresponding to a notification event’ mayalso be referred to as ‘notification message information.’

Throughout the specification, ‘content’ refers to digital informationprovided via a wired or wireless communication network. Contentaccording to an exemplary embodiment may include, for example, videocontent, still image content (e.g., pictures, drawings, etc.), textcontent (e.g., news articles, letters, webpages, etc.), music content(e.g., music, instrumentals, radio broadcasts, etc.), but is not limitedthereto.

According to an exemplary embodiment, ‘content corresponding to anotification event’ may include at least one of schedule notificationcontent (e.g., medication notification comment, schedule notificationcomment, etc.), tourist attraction notification content (e.g.,explanation content of historical sites, opening and closing times fortourist attractions, etc.), traffic information notification content(e.g., bus running schedule, notification of congestion, etc.),advertisement notification content (e.g., coupons, sales start/endtimes, etc.), update notification content (e.g., update notification forsoftware or hardware, update information for other notificationcontent—for example update of a tourist attraction open/close schedule,etc.), recommended content (e.g., recommended book information,recommended music information, etc.), health information notificationcontent (e.g., blood sugar level information, heart rate information,temperature information, etc.), and emergency notification content(e.g., a fire nearby, an earthquake occurrence, etc.), but is notlimited thereto. Hereinafter, ‘content corresponding to a notificationevent’ may also be referred to as ‘notification content’ for convenienceof description.

According to an exemplary embodiment, the wearable glasses 100 mayprovide notification content in various forms. For example, the wearableglasses 100 may display notification content on a display in the form ofaugmented reality (AR), mixed reality (MR) or virtual reality (VR).

When a wearable glasses immediately outputs notification content whenoccurrence of a notification event is sensed, without taking the user'ssituation into account, the user may be exposed to a dangeroussituation. Thus, according to an exemplary embodiment, hereinafter, amethod of the wearable glasses 100 determining a time to providenotification content and a form of providing the notification contentbased on movement information (also referred to as ‘movement state’ or‘movement pattern information’ below) of a user will be described.First, an external appearance of the wearable glasses 100 will bedescribed in detail with reference to FIGS. 2 and 3.

FIGS. 2 and 3 illustrate diagrams for describing an external appearanceof the wearable glasses 100 according to exemplary embodiments.According to the exemplary embodiments of FIGS. 2 and 3, it is assumedthat the wearable glasses 100 is in the form of glasses.

Referring to FIG. 2, the wearable glasses 100 may include a frame 101, alens 102, a power source 103, a display 111, a sound output unit 112, acontroller 120, a user input unit 130, an image sensor 161, and a depthsensor 154. However, the elements illustrated in FIG. 2 are not allnecessary elements of the wearable glasses 100. The wearable glasses 100may include more or less elements than those illustrated in FIG. 2. Forexample, according to some exemplary embodiments, the wearable glasses100 may omit the lens 102.

Some of the elements included in the wearable glasses 100 may be mountedinside the wearable glasses 100, and some other elements may be mountedon an outer portion of the wearable glasses 100. For example, the powersource 103 and the controller 120 may be mounted inside the wearableglasses 100. The display 111, the sound output unit 112, the user inputunit 130, the image sensor 161, and the depth sensor 154 may be mountedon the outer portion of the wearable glasses 100. The elements mountedinside the wearable glasses 100 and the elements mounted on the outerportion of the wearable glasses 100 are not limited to theabove-described elements.

The frame 101 may include a material such as a plastic and/or metal andmay include wirings that connect the elements included in the wearableglasses 100 to one another.

According to an exemplary embodiment, the frame 101 may include aconnection member (not shown) to have a partially foldable structure.Also, according to an exemplary embodiment, the wearable glasses 100 mayfurther include an elastic band that allows a user to wear the wearableglasses 100 on the head regardless of the size of the head.

Meanwhile, according to an exemplary embodiment, the lens 102 may bedetachably mounted in the frame.

The lens 102 may include a transparent material that allows the user tosee an area in front of him/her. For example, the lens 102 may include aplastic such as polycarbonate or a glass material, but is not limitedthereto.

According to an exemplary embodiment, the lens 102 may include at leastone of anti-light reflection and anti-dazzling coating, anti-fogcoating, and anti-ultraviolet (UV) coating.

The power source 103 may supply power to each element of the wearableglasses 100 so that the wearable glasses can operate. The power sourcemay include a rechargeable battery (not shown) and a cable (not shown)or a cable port (not shown) through which power may be received from theoutside.

The power source 103 may be disposed at various positions on the frame101 of the wearable glasses 100. For example, the power source 103 maybe disposed at an end of the frame 101 of the wearable glasses 100.

The display 111 may include a semi-transparent optical waveguide (e.g.,a prism). The semi-transparent optical waveguide may reflect lightoutput from a projector to focus an image on fovea of the retina of theeyes of the user. According to an exemplary embodiment, the display 111may display content corresponding to a notification event when thenotification event has occurred. The content may be notification messageinformation. The notification message information may be anadvertisement message to be advertised to an unspecified number ofpersons or may be an advertisement message that is addressed just to theuser of the wearable glasses 100. Also, according to an exemplaryembodiment, the notification message information may be related to anapplication. The application may be predetermined. The notificationmessage information may be received via a communication interface. Also,the notification message information may be generated inside thewearable glasses 100. For example, a message indicating a batteryremaining amount may be generated inside the wearable glasses 100. Asanother example, a message indicating a current sound level orbrightness level may be generated inside the wearable glasses 100. Asyet another example, a message indicating a current tilt angle of thewearable glasses 100 or diagnostic information for the wearable glasses100 may be generated inside the wearable glasses 100.

Also, the display 111 may be used to replace the lens 102 or a portionof the lens 102 according to the inventive concept. That is, the display111 may be used in place of the lens 102 or a portion of the lens 102.

In regard to wearable glasses, the lens 102 and a display area may bethe same. In this case, the notification message information may bereceived while the user is looking at an actual object through the lens102, and the received notification message information may be displayedon the lens 102. If the notification message information is displayedoutside an angle of view of the user from among the entire area of thelens 102, the user has to move the pupils to see the notificationmessage information. On the other hand, if the notification messageinformation is displayed on an area corresponding to an angle of view ofthe user from among the entire area of the lens 102, the user does nothave to turn his/her head or move his/her pupils to view thenotification message information.

Thus, when the user is wearing the wearable glasses 100 in the form ofwearable glasses, a first area corresponding to an angle of view of theuser may be set on the display 111, and the notification messageinformation may be displayed in the first area. An angle of view of auser may refer to an angle or range within which the user is able toperceive an object without turning his/her head or his/her pupils whilethe user is looking in front of him or her. For example, an angle ofview of a user may be 45 degrees in each of upward and downwarddirections and 90 degrees in each of left and right directions, but isnot limited thereto. The angle of view may be determined experimentallyfor each user. Alternatively, the angle of view may be set at themanufacturer, or may be set by the user using settings of the wearableglasses 100.

According to an exemplary embodiment, a first area corresponding to anangle of view of a user may be the same as or smaller than the entiredisplay area. Also, a first area corresponding to an angle of view of auser may be determined or adjusted based on a distance from the eyes ofthe user to the lens 102.

The sound output unit 112 may be configured in the form of earphonesthat can be worn on the ears of the user. In this case, the sound outputunit 112 may be mounted in the wearable glasses 100. For example, thesound output unit 112 may include a bone conduction speaker. In someexemplary embodiments, the sound output unit 112 may expend part-wayinto the ears of the user.

Also, the sound output unit 112 may be detachably mounted to thewearable glasses 100. In this case, the user of the wearable glasses 100may selectively mount the sound output unit 112 on the ears.

The controller 120 may be connected to the wearable glasses 100 in awired or wireless manner so as to control each element of the wearableglasses 100. For example, the controller 120 may receive data from theimage sensor 161 or the user input unit 130, analyze the received data,and output notification content through at least one of the display 111and the sound output unit 112.

The user input unit 130 receives a user input. A user input may include,for example, a command or a request from a user to start or end anoperation of the wearable glasses 100. The operation may bepredetermined.

According to an exemplary embodiment, the user input unit 130 mayinclude a touch panel to receive a touch input. Throughout thespecification, a “touch input” refers to a gesture performed by a useron the touch panel to control the wearable glasses 100. For example, atouch input described in the present specification may be a tap, a touchand hold, a double tap, a drag, panning, a flick, and a drag and drop.

According to an exemplary embodiment, the user input unit 130 mayinclude a bending sensor for receiving a bending input. Throughout thespecification, a “bending input” refers to a user input for bending thewhole HMS apparatus 100 or for bending a partial area of the wearableglasses 100 to control the wearable glasses 100. According to anexemplary embodiment, the wearable glasses 100 may sense by using abending sensor, for example, a bending position (coordinate values), abending direction, a bending angle, a bending speed, the number of timesof bending, a time when a bending operation is generated or a period formaintaining a bending operation, etc.

According to an exemplary embodiment, the user input unit 130 mayreceive a multiple input. Throughout the specification, a “multipleinput” refers to combination of at least two input methods. For example,the wearable glasses 100 may receive a touch input and a motion input ofa user or may receive a touch input and a sound input of a user. Also,the wearable glasses 100 may receive a touch input and an eyeball inputof a user. An eyeball input refers to a user input for adjusting eyeblinking, gaze positions, an eyeball movement speed or the like tocontrol the wearable glasses 100.

Meanwhile, according to an exemplary embodiment, the wearable glasses100 may further include a microphone (not shown). The microphone mayreceive a sound corresponding to a user's voice and/or environmentalsounds generated around the wearable glasses 100.

The image sensor 161 may be implemented using a compact camera such as acamera used in smartphones or webcams. The image sensor 161 may bemounted near the eyes of the user when the user wears the wearableglasses 100 and may capture an image similar to an image receivedthrough the eyes of a user.

According to an exemplary embodiment, the wearable glasses 100 mayfurther include the depth sensor 154. The wearable glasses 100 mayrecognize a three-dimensional spatial gesture of a user. For example,the depth sensor 154 may measure a depth value or the like of aninputting instrument (e.g., a hand or hands, a finger or fingers, or anelectronic pen, etc.).

According to an exemplary embodiment, the depth sensor 154 may obtain adepth value of an inputting instrument by using various methods. Forexample, the depth sensor 154 may measure a depth value by using atleast one of a time of flight (TOF) method, a stereoscopic visionmethod, and a structured light pattern method.

According to the TOF method, a time taken for light to be reflected byan object and to return to a light source is analyzed to measure adistance from the light source to the object. In a TOF system, aninfrared LED emits infrared light, and a time taken for the light to bereflected by an object and return to the infrared LED is measured byusing an infrared camera. In this case, the depth sensor 154 may includean infrared LED and an infrared camera. The depth sensor 154 may acquiredistance information as a video by repeatedly emitting and receivinglight several tens of times per second. Also, the depth sensor 154 maycreate a depth map that expresses distance information via luminance orcolors of pixels. The sample time of several tens of times per second isonly an example, and the sample time may be greater or less than severaltens of times per second.

According to the stereoscopic vision method, two cameras are used tocapture a stereoscopic image of an object. In this case, the depthsensor 154 may include two cameras. The depth sensor 154 may calculate adistance between the depth sensor 154 and the object based on thetriangulation principle by using difference information regarding imagesviewed from the respective cameras. Humans perceive stereoscopic imagesbased on a difference between respective images viewed by the left eyeand the right eye, and the depth sensor 154 measures a distance betweenthe depth sensor 154 and the object by the respective cameras in asimilar manner to the principle of human eyes. For example, if adistance between the depth sensor 154 and the object is small, adifference between images respectively captured by two cameras is great,and if a distance between the depth sensor 154 and the object is great,a difference between images respectively captured by two cameras issmall.

According to the structured light pattern method, patterned light isemitted from a light source to an object and a location of patternsformed on a surface of the object is analyzed to measure a distance fromthe light source to the object. The depth sensor 154 typically emitslinear or dot-pattern light to an object and patterns vary according tocurves of the object.

The structured light pattern method may correspond to a stereoscopicvision method in which one of two cameras is replaced by an opticalprojector. For example, the depth sensor 154 may calculate a depth mapin real time by analyzing a position of a pattern formed by lightemitted from an infrared projector on a surface of an object by using acertain algorithm.

According to an exemplary embodiment, the image sensor 161 and the depthsensor 154 may be different sensors. According to another exemplaryembodiment, the image sensor 161 and the depth sensor 154 may beintegrated in a single sensor.

According to an exemplary embodiment, the wearable glasses 100 mayfurther include other various sensors besides the image sensor 161 andthe depth sensor 154.

For example, the wearable glasses 100 may include sensors for sensing amotion input of a user. Throughout the specification, a “motion input”refers to a motion applied to the wearable glasses 100 by a user tocontrol the wearable glasses 100. For example, a motion input mayinclude a user input for rotating the wearable glasses 100, tilting thewearable glasses 100, or moving the wearable glasses 100 in an upward ordownward direction or to the left or the right. The wearable glasses 100may sense a motion of a user by using, for example, an accelerationsensor, a tilt sensor, a gyro sensor, or a 3-axis magnetic sensor. Themotion may be preset by the user. For example, a user may set that acertain tilt angle corresponds to a certain input.

Also, the wearable glasses 100 may include a sensor for sensing whetherthe user is wearing the wearable glasses 100. For example, the wearableglasses 100 may include a temperature sensor, a pressure sensor, anacceleration sensor, a proximity sensor, or an iris scan sensor.

The wearable glasses 100 may further include an eyeball-tracking camera(not shown) that faces the face of the user. The eyeball-tracking cameramay include an infrared camera. The eyeball-tracking camera may detect agaze of the user by tracking the pupil of the user.

Referring to FIG. 3, the wearable glasses 100 may be configured suchthat the lens 102 functions as the display 111. In this case, the lens102 may be formed of a transparent display or a semi-transparentdisplay. When the lens 102 is formed of a semi-transparent display, thelens 102 may be formed of at least one of an optical wave guide (e.g., aprism), an electroluminescent display, and a liquid crystal display, butis not limited thereto.

While the wearable glasses 100 implemented using glasses is describedwith reference to FIGS. 2 and 3, the wearable glasses 100 is not limitedthereto. For example, the wearable glasses 100 may be attached to ahelmet structure or applied in the form of goggles.

According to an exemplary embodiment, the wearable glasses 100 may be astand-alone device that is operable without help of other devices. Also,the wearable glasses 100 may be a device linked with a mobile terminalor a cloud server. Hereinafter, an exemplary embodiment in which thewearable glasses 100 is linked with other devices will be described withreference to FIG. 4.

FIG. 4 illustrates a diagram for describing a notification systemaccording to an exemplary embodiment.

Referring to FIG. 4, the notification providing system according to anexemplary embodiment may include a wearable glasses 100, a mobileterminal 200, and a server 300. However, not all of elements illustratedin FIG. 4 are essential elements of the notification providing system.The notification providing system may be implemented using more elementsor fewer elements than the elements illustrated in FIG. 4. For example,the notification providing system may be implemented using the wearableglasses 100 and the mobile terminal 200 omitting the server 300, orusing the wearable glasses 100 and the server 300 omitting the mobileterminal 200.

The wearable glasses 100 may be communicatively connected to the mobileterminal 200 or the server 300. For example, the wearable glasses 100may perform short-range communication with the mobile terminal 200.Examples of short-range communication are Wi-Fi, Near FieldCommunication (NFC), Bluetooth, Bluetooth Low Energy (BLE), Wi-Fi Direct(WFD), and Ultra wideband (UWB), but are not limited thereto. Thewearable glasses 100 may be connected to the server 300 via wirelesscommunication or mobile communication. Moreover, in some exemplaryembodiments, the wearable glasses 100 may include a plurality ofcommunication methods. For example, the wearable glasses 100 may includeboth short-range communication and wireless communication, or mayinclude a plurality of short-range communication methods.

The mobile terminal 200 may transmit data to the wearable glasses 100 orreceive data from the wearable glasses 100. For example, the mobileterminal 200 may transmit a notification message or a control command tothe wearable glasses 100. The data may be predetermined.

The mobile terminal 200 may be implemented in various forms. Forexample, the mobile terminal 200 described in the present specificationmay be a mobile phone, a smartphone, a laptop computer, a tablet PC, ane-book terminal, a digital broadcasting terminal, a personal digitalassistant (PDA), a portable multimedia player (PMP), a navigationdevice, a MP3 player, or a digital camera, but is not limited thereto.

The server 300 may be a cloud server that controls the wearable glasses100. Also, the server 300 may be a content provider providing anotification message.

According to an exemplary embodiment, the server 300 may include anintelligence engine and analyze a movement of a user by using theintelligence engine. An operation of analyzing a movement of a user,performed by the server 300 will be described in detail later withreference to FIG. 13. A movement of the user may be analyzed, other thanby using the server 300, by using the wearable glasses 100 or the mobileterminal 200 that is connected to the wearable glasses 100 viashort-range communication or is communicatively connected to thewearable glasses 100.

In addition, the movement of the user analyzed by using the server 300may be directly transmitted to the wearable glasses 100 or may betransmitted to the wearable glasses 100 via the mobile terminal 200 thatis connected to the wearable glasses 100 via short-range communicationor is communicatively connected to the wearable glasses 100.

Hereinafter, a method of a wearable glasses 100 providing notificationcontent based on movement information of a user, according to anexemplary embodiment, will be described in detail with reference toFIGS. 5A through 5C.

FIG. 5A illustrates a flowchart of a method used by a wearable glassesto provide content based on movement information of a user, according toan exemplary embodiment.

In operation S510, the wearable glasses 100 may detect an occurrence ofa notification event.

According to an exemplary embodiment, the wearable glasses 100 may sensethat internal system notification information or external notificationinformation to be notified to the user is generated. For example, when abattery remaining amount is equal to a threshold value or less, thewearable glasses 100 may sense that an event for displaying anotification message regarding the battery remaining amount isgenerated.

Also, when receiving notification message information from the mobileterminal 200 or the server 300, the wearable glasses 100 may sense thatan event for outputting the notification message information hasoccurred. Here, the wearable glasses 100 may receive notificationmessage information via a communication interface.

Also, when an event for outputting notification message information hasoccurred, the wearable glasses 100 may change a color of the display111. That is, the controller 120 may control the display 111 to changethe color thereof based on reception of the notification messageinformation.

For example, when a notification message has arrived, the display 111may display the entire screen in, for example, orange for one second. Asthe entire display 111 is changed to orange, the user may sense that anotification message has arrived. However, this is only an example, andalternatively, the display 111 may display a portion of the screen in acertain color. Additionally, the time for displaying the notificationmessage is also only an example, and the notification message may bedisplayed for more or less than one second.

In operation S520, upon detecting occurrence of a notification event,the wearable glasses 100 may obtain movement information of the user whois wearing the wearable glasses 100, and determine a movement state ofthe user based on the movement information.

Movement information of a user may be information about movement of auser who is wearing the wearable glasses 100. Movement information of auser may be information about movement of a user in a narrow sense.Alternatively, or additionally, the movement information may includechanges of biometric information of the user in a broad sense. Forexample, movement information of a user may include one or more ofinformation about a movement of a user, movement speed information ofthe user, movement direction information of the user, tilt informationof the user, altitude information of the user, biometric information ofthe user (e.g., body temperature information, pulse rate information,sweat secretion information, etc.), eyeball-tracking information of theuser (e.g., pupil recognition information, eye blinking frequencyinformation, eye blinking speed information, gaze direction information,etc.), and user position information (e.g., GPS coordinates information,regional information, building information, information about avariation in positions for a time period, etc.), but is not limitedthereto. Movement information of a user may also include user voiceinformation perceived through a microphone while the user is speaking,alcohol smell information measured based on user's drinking or the like.

According to an exemplary embodiment, the wearable glasses 100 may sensemovement information of a user by using at least one sensor included inthe wearable glasses 100. For example, the wearable glasses 100 maysense movement information of a user by using at least one of anacceleration sensor, a position sensor, a tilt sensor, a pressuresensor, an altitude (atmospheric pressure) sensor, a biometric sensor,an iris scan sensor, an image sensor, a microphone, a smell sensor, anda temperature sensor.

Also, the wearable glasses 100 may determine a movement state of a userbased on movement information of a user. A movement state of a user mayinclude, for example, a walking state, a standstill state, a runningstate, a sleeping state, a driving state, a commuting state, a speakingstate (or conversation state), or an exercise state (e.g., jogging,swimming, tennis, basketball, or hiking) but is not limited thereto. Anexample of determining a movement state of a user based on user movementinformation, performed by the wearable glasses 100, will be described indetail.

FIGS. 5B and 5C illustrate diagrams for describing a method used by awearable glasses to determine a movement state of a user based onmovement information of the user, according to an exemplary embodiment.

Referring to FIGS. 5B and 5C, the wearable glasses 100 may determinewhether the user is in a standstill state or a running state by using atleast one of an acceleration sensor, a tilt sensor, a position sensor,and a pressure sensor. For example, the wearable glasses 100 maydetermine that, by using acceleration information measured using theacceleration sensor: 1) when the user has moved at the average speed of0.001 km/h per a certain period, the user is in a standstill state(i.e., is resting); 2) when the user has moved at the average speed of 4km/h per a certain period, the user is in a walking state; and 3) whenthe user has moved at the average speed of 15 km/h per a certain period,the user is in a running state. The certain period may be predetermined.

Alternatively, the wearable glasses 100 may determine, by using positionvariation information measured using a position sensor, whether the useris in a standstill state (e.g., position variation<first variation), ina walking state (e.g., first variation≤position variation<secondvariation), or in a running state (second variation≤position variation).Moreover, the wearable glasses 100 may used both accelerationinformation and position variation information in order to increase thecertainty of the determination, or to provide verification.

Similarly, as another alternative, the wearable glasses 100 maydetermine, by using tilt information measured using a tilt sensor,whether the user is in a standstill state (e.g., tilt variation<firstthreshold), in a walking state (e.g., first threshold≤tiltvariation<second threshold), or in a running state (e.g., secondthreshold≤tilt variation). The higher the movement speed of the user,the higher may be the tilt variation measured using the tilt sensor. Asdiscussed above, the wearable glasses 100 may be more than one of theacceleration information, the position variation information, and thetilt information to provide additional certainty or to provideverification.

Similarly, the wearable glasses 100 may determine, by using pressureinformation regarding a pressure applied to a pressure sensor attachedon nose pads of wearable glasses during movement of a user, whether theuser is in a standstill state (e.g., measured pressure<first pressure),in a walking state (e.g., first pressure≤measured pressure<secondpressure), or in a running state (e.g., second pressure≤measuredpressure). The higher the movement speed of the user, the higher may bethe pressure measured using the pressure sensor. As with the otherinformation, the pressure information may be used as a single datapoint, or may be combined with one or more other information in order toprovide additional certainty or verification.

The wearable glasses 100 may also determine whether the user is in astanding state, a sitting state or a lying down state by using analtitude sensor (atmospheric pressure sensor). For example, the wearableglasses 100 may determine, by using altitude information measured usingthe altitude sensor (atmospheric pressure sensor), that 1) when ameasured altitude value is a first altitude or greater (altitude≥firstaltitude value), the user is standing; 2) when a measured altitude valueis smaller than the first altitude value and equal to or greater than asecond altitude value, the user is sitting (first altitudevalue>measured altitude≥second altitude value); and 3) when a measuredaltitude value is smaller than the second altitude value, the user islying down (altitude<second altitude value). An altitude value measuredusing the altitude sensor may be smaller when the user is lying thanwhen the user is standing.

Turning to FIG. 5C, the wearable glasses 100 may determine that a useris in a hiking state via at least one of an acceleration sensor, analtitude sensor, a position sensor, and a biometric sensor. For example,the wearable glasses 100 may determine that the user is hiking when analtitude variation during a certain period measured using the altitudesensor is equal to or greater than a threshold value (altitudevariation≥threshold value), and/or when position information measuredusing the position sensor is ‘mountainous area,’ and/or an amount ofsweat secretion, temperature variation, and/or an average pulse ratemeasured using the biometric sensor are greater than a threshold value(sweat secretion amount>threshold value, temperature variation>thresholdvalue, average pulse rate>threshold value).

The wearable glasses 100 may determine that a user is in a sleepingstate via at least one of an iris scan sensor, an image sensor, amicrophone, an accelerate sensor, and a tilt sensor. For example, thewearable glasses 100 may determine that the user is in a sleeping statewhen the number of times of eye blinking of the user, which is measuredusing an iris scan sensor, is less than a threshold number of times(e.g., one time per ten minutes is detected) and/or when an iris is notscanned during a certain period of time (e.g., iris is not scanned forfive minutes). The certain period of time may be predetermined.

Additionally or alternatively, the wearable glasses 100 may capture animage of the eyes of a user at certain periods of time by using an imagesensor and may detect the pupils by performing edge analysis on theimage of the eyes. The certain period of time may be predetermined. Ifthe pupils are not detected from the image of the eyes for a certainperiod of time (for example, if the pupils are not detected for fiveminutes or more), the wearable glasses 100 may determine that the useris in a sleeping state.

Additionally or alternatively, the wearable glasses 100 may analyze asound signal obtained through a microphone, and if a sound correspondingto a snoring pattern is sensed, the wearable glasses 100 may determinethat the user is in a sleeping state. Moreover, if a motion value of thehead measured using an acceleration sensor or a tilt sensor is equal orgreater than a threshold value, the wearable glasses 100 may determinethat the user is dosing off while sitting.

Additionally or alternatively, the wearable glasses 100 may determinewhether the user is in a speaking state (or is having a conversation)based on sound information obtained through a microphone. For example,the wearable glasses 100 may analyze sound information obtained throughthe microphone, and if voice of the user is recognized, the wearableglasses 100 may determine that the user is speaking. Also, if a voice ofother person than the voice of the user is recognized from the soundinformation obtained through the microphone, the wearable glasses 100may determine that the user is having a conversation.

The wearable glasses 100 may determine a drinking state of a user basedon smell information measured using a smell sensor. For example, thewearable glasses 100 may analyze smell information measured using asmell sensor, and if an alcohol smell is recognized for a period oftime, the wearable glasses 100 may determine that the user is drinkingalcohol. The period of time may be predetermined.

The wearable glasses 100 may determine whether a user is in a drivingstate by using at least one of an acceleration sensor, an image sensor,and a short-range communication module. For example, when a speedvariation measured using the acceleration sensor is equal to or greaterthan a threshold value (e.g., an average of 40 km/h) and/or a steeringwheel of a car is detected from an image captured using the image sensor(that is, when a steering wheel of a car is detected according to an eyeangle of the user who is looking straight ahead), the wearable glasses100 may determine that the user is in a driving state.

Additionally or alternatively, the wearable glasses 100 may determinethat the user is in a driving state based on information received from acar through short-range communication (e.g., Bluetooth). For example,when the user touches a starting button, the car identifies afingerprint of the user and transmits driving starting information towearable glasses that match the fingerprint of the user with a certainfingerprint. In this case, the wearable glasses may recognize that theuser is starting to drive based on the driving starting informationreceived from the car. The certain fingerprint may be predetermined.

According to an exemplary embodiment, the wearable glasses 100 maydetermine a commuting state of a user based on context information of auser. Context information may be stored in a personalized server of theuser or in the wearable glasses 100.

For example, the wearable glasses 100 may determine a commuting state ofa user based on schedule information or life pattern information of theuser. If the user moves from home to a certain location (e.g.,workplace) at 8 am on weekdays, the wearable glasses 100 may receivecommuting time information, commuting distance information, andworkplace location information of the user as context information. Thecertain location may be predetermined. When current time is 8:20 am onMonday and a current position is near a subway station, the wearableglasses 100 may determine that the user is going to work.

Also, if an average movement speed of the user for a period of time is0.0001 km/h and the user is located in an office for a period of time,the wearable glasses 100 may determine that the user is at work. Theperiods of time may be predetermined.

According to an exemplary embodiment, the wearable glasses 100 mayanalyze a movement state of the user based on biometric informationmeasured using an external wearable device. The wearable deviceaccording to an exemplary embodiment may include a ring, a necklace, aband, a watch, shoes, an earring, a hair band, clothes, gloves, or athimble, but is not limited thereto.

For example, the wearable glasses 100 may receive pulse rateinformation, blood pressure information, heart rate information, bodytemperature information or the like measured using a wearable device.The wearable glasses 100 may receive biometric information from thewearable device via the mobile terminal 200 or may receive biometricinformation directly from the wearable device. The wearable glasses 100may determine that the user is exercising if an average pulse rate ofthe user is equal to a threshold frequency or higher for a period oftime. The period of time may be predetermined.

According to an exemplary embodiment, the wearable glasses 100 maydetermine, based on acceleration information, pressure information,and/or altitude information measured from a peripheral wearable device,such as running shoes or shoe insoles, whether the user is in a restingstate, a walking state, a running state, or a hiking state. For example,the wearable glasses 100 may determine that the user is in a hikingstate when a movement speed of the user is equal to a threshold value orhigher and a pressure pattern of soles measured from a pressure sensorattached to running shoes of the user is similar to a pattern in regardto hiking.

According to an exemplary embodiment, the wearable glasses 100 maydetermine a movement state of a user based on mode information set bythe user. For example, the user may manually set an operating mode ofthe wearable glasses 100 to a driving mode, an exercise mode, or acommuting mode. For example, if the user sets an operating mode of thewearable glasses 100 to a driving mode, the wearable glasses 100 maydetermine that the user is driving.

The controller 120 may determine a movement state of a user based onmovement information of the user, and may control the display 111 todisplay notification message information received according to themovement state of the user.

According to an exemplary embodiment, the wearable glasses 100 mayrequest from an external device connected to the wearable glasses 100movement state information of a user and receive the same. The externaldevice may be the mobile terminal 200 or the server 300. An operation ofan external device to analyze a movement state of a user will bedescribed in detail later with reference to FIG. 13.

In operation S530, the wearable glasses 100 may determine a method ofproviding content corresponding to a notification event (notificationmessage information) based on the determined movement state of the user.

According to an exemplary embodiment, the wearable glasses 100 maydetermine a time to provide notification content (notification messageinformation). For example, the wearable glasses 100 may determinewhether a movement speed of the user is less than a threshold speedbased on a movement state of the user. When the movement speed of theuser is less than a threshold speed (e.g., 3 km/h), the wearable glasses100 may determine to output notification content at a present time. Thepresent time may indicate a time period within a certain time from atime when the wearable glasses 100 has detected occurrence of anotification event (for example, within 30 seconds). The certain timemay be predetermined.

Meanwhile, when a movement speed of a user is equal to or greater than athreshold speed, the wearable glasses 100 may determine to outputnotification content at a different time. The different time may be atime that is previously set (for example, 10 pm). Alternatively, thedifferent time may be a certain amount of time later than a present time(e.g., in 10 minutes). Alternatively, the different time may be acertain amount of time later than a present time at which anotherdetermination of the movement state of the user is made. For example, ifa user is determined to be in a running state, the wearable glasses 100may determine to wait 10 minutes and then re-determine the movementstate of the user. If the re-determined state of the user is a standingstate, then the wearable glasses 100 may output the notification. Also,the different time may indicate a time when a certain event hasoccurred. The certain event may be predetermined.

The certain event may include at least one of an event for receiving auser input for requesting output of notification content, an eventwhereby an amount of time passes, and an event for changing a movementstate of a user, but is not limited thereto.

According to an exemplary embodiment, the wearable glasses 100 maydetermine the method of providing the content by determining a form ofproviding notification content. The form of providing notificationcontent may include display form for displaying the notificationcontent. For example, the wearable glasses 100 may determine whether amovement speed of a user is less than a threshold speed (e.g., 4 km/h)based on movement state of the user. When the movement speed of the useris equal to or greater than the threshold speed, the wearable glasses100 may determine to output a portion of notification content, and ifthe movement speed of the user is less than the threshold speed, thewearable glasses 100 may determine to output the entire notificationcontent.

A portion of content may include at least one of a keyword of thecontent, summary information of the content, and a title of the content,but is not limited thereto.

According to an exemplary embodiment, the wearable glasses 100 maydetermine to provide notification content in the form of at least one ofan audio signal and a video signal based on a movement state of theuser. For example, when the user is in a speaking state (e.g., talkingto another person), the wearable glasses 100 may determine to outputnotification content as a video signal, and if the user is in a drivingstate, the wearable glasses 100 may determine to output notificationcontent as an audio signal.

Hereinafter, an operation of the wearable glasses 100 to providenotification content based on whether the user is wearing the wearableglasses 100 will be described in detail with reference to FIG. 6.

FIG. 6 illustrates a flowchart of a method used by a wearable glasses toprovide content corresponding to a notification event based on whether auser is wearing a wearable glasses or not, according to an exemplaryembodiment.

In operation S610, the wearable glasses 100 may detect an occurrence ofa notification event. Operation S610 corresponds to operation S510 ofFIG. 5, and thus detailed description thereof will be omitted.

In operation S620, the wearable glasses 100 may determine whether theuser is wearing the wearable glasses 100.

According to an exemplary embodiment, the wearable glasses 100 maydetermine whether the user is wearing the wearable glasses 100 by usinga sensor included in the wearable glasses 100 (e.g., at least one of atemperature sensor, a pressure sensor, an illuminance sensor, aproximity sensor, an iris scan sensor, and a pressure sensor, etc.). Forexample, when a value of a temperature sensor attached to nose pads orlegs of glasses, or a value of a pressure sensor is equal to or greaterthan a threshold value, the wearable glasses 100 may determine that theuser is wearing the wearable glasses 100. Alternatively, the wearableglasses 100 may scan an iris of the user. When the wearable glasses 100succeeds in scanning an iris of the user by using an iris scan sensor,the wearable glasses 100 may determine that the user is wearing thewearable glasses 100.

Alternatively, when a tile value measured using a tilt sensorcontinuously changes, the wearable glasses 100 may determine that theuser is wearing the wearable glasses 100.

Alternatively, when a speaker and a microphone are included inside legsof glasses, the wearable glasses 100 may output a sound signal throughthe speaker and obtain a reflected echo signal through the microphone.The wearable glasses 100 may determine whether the user is wearing thewearable glasses 100 based on information about the echo signal.

According to an exemplary embodiment, the wearable glasses 100 maycombine pieces of information measured using a plurality of sensors tofurther accurately determine whether the user is wearing the wearableglasses 100.

When it is determined that the user is wearing the wearable glasses 100(S620, YES), the wearable glasses 100 may obtain movement information ofthe user, and determine a movement state of the user based on themovement information in operation S630. In operation S640, the wearableglasses 100 may determine a method of providing notification contentbased on the determined movement state of the user. Operations S630 andS640 respectively correspond to operations S520 and S530 of FIG. 5, andthus detailed description thereof will be omitted.

On the other hand, when it is determined that the user is not wearingthe wearable glasses 100 (S620, NO), the process ends without thewearable glasses 100 providing notification content even if occurrenceof a notification event is sensed.

FIG. 7 illustrates a flowchart of a method used by a wearable glasses todetect an occurrence of a notification event, according to an exemplaryembodiment.

In operation S710, an external device 700 may generate a notificationmessage. The notification message may be an advertisement message to beadvertised to an unspecified number of persons, or a message only forthe user of the wearable glasses 100. Also, according to an exemplaryembodiment, a notification message may be a message related toapplication. The application may be predetermined.

The external device 700 may be at least one of the server 300 connectedto the wearable glasses 100, the mobile terminal 200 connected to thewearable glasses 100, a wearable device connected to the wearableglasses 100, and a device of another person. However, the externaldevice 700 is not limited thereto, and may be any device that isexternal to the wearable glasses 100 and that generates a notificationmessage.

In operation S720, the external device 700 may transmit the generatednotification message to the wearable glasses 100. The external device700 may transmit the generated notification message to the wearableglasses 100 via at least one of short-range communication, wirelesscommunication, and mobile communication.

In operation S730, when the wearable glasses 100 receives a notificationmessage, the wearable glasses 100 may determine whether the notificationmessage is to be blocked. For example, the user of the wearable glasses100 may block reception of a push message related to an application ormay block a text message received from a certain user, by using thewearable glasses 100 or the mobile terminal 200. The application may bepredetermined and the certain user may be predetermined.

When the wearable glasses 100 determines that the notification messageis not to be blocked (S730, NO) wearable glasses 100 may detect anoccurrence of a notification event in operation S740. On the other hand,when the wearable glasses 100 determined that the notification messageis to be blocked (S730, YES), the process ends.

According to an exemplary embodiment, operation S730 may be omitted. Forexample, when a notification message is received from the externaldevice 700, the wearable glasses 100 may determine that a notificationevent has occurred.

FIG. 8 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving a notification messagefrom a server, according to an exemplary embodiment.

Referring to FIG. 8, the wearable glasses 100 may receive a push message810 from a news providing server 800. For example, the wearable glasses100 may receive a push message 810 including breaking news from the newsproviding server 800. For example, the breaking news may be “SochiOlympics, Yuna Kim, Silver Medal!”

In this case, the wearable glasses 100 may sense that a notificationevent for displaying breaking news content has occurred (for example,“Sochi Olympics, Yuna Kim, silver medal!”).

According to an exemplary embodiment, the wearable glasses 100 mayreceive the push message 810 directly from the news providing server800. Also, the wearable glasses 100 may receive the push message 810from a host device (e.g., the mobile terminal 200) when the host deviceis located within a short-range communication radius. The push messagemay then be displayed 820 by the wearable glasses 100 according to oneof the processes discussed above.

FIG. 9 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving a schedule notificationmessage from a mobile terminal, according to another exemplaryembodiment.

Referring to FIG. 9, schedule information 910 of a user may be stored inthe mobile terminal 200 connected to the wearable glasses 100. Forexample, the user may register the schedule information 910 by using themobile terminal 200. Alternatively the user may register the scheduleinformation 910 using a computer and transmit or otherwise upload theschedule information 910 to the mobile terminal 200. The user may setthe mobile terminal 200 such that a schedule notification messagenotifying “medication at 7 pm” is output by the wearable glasses 100.

When it is 7 pm, the mobile terminal 200 may transmit the schedulenotification message notifying medication to the wearable glasses 100.The schedule notification message may include a command for displayingschedule notification content 920.

According to an exemplary embodiment, the mobile terminal 200 maytransmit a schedule notification message to the wearable glasses 100 viashort-range communication (e.g., Bluetooth, WFD, or NFC).

In this case, the wearable glasses 100 may sense that a notificationevent for displaying the schedule notification content 920 (e.g., “Timeto take the medicine.”) has occurred.

FIG. 10 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving a text message via amobile terminal, according to another exemplary embodiment.

Referring to FIG. 10, the mobile terminal 200 may receive a text message1010 from the server 300. The server 300 may be, for example, a messageserver or a mobile communication server, but is not limited thereto.

When receiving the text message 1010, the mobile terminal 200 maydetermine whether a user is wearing the wearable glasses 100.

According to an exemplary embodiment, the mobile terminal 200 mayrequest from the wearable glasses 100 at least one of temperatureinformation, pressure information, iris scanning information, and tiltinformation, or other information on which the determination may bebased. The mobile terminal 200 may receive at least one of temperatureinformation, pressure information, iris scanning information, and tiltinformation or other information from the wearable glasses 100. Themobile terminal 200 may determine whether a user is wearing the wearableglasses 100 based on at least one of temperature information, pressureinformation, iris scanning information, and tilt information, or theother information. For example, the mobile terminal 200 may analyzetemperature information received from the wearable glasses 100 and if atemperature measured using the wearable glasses 100 is similar to bodytemperature (e.g., 36.5° C.), the mobile terminal 200 may determine thatthe user is wearing the wearable glasses 100.

According to an exemplary embodiment, the mobile terminal 200 mayrequest from the wearable glasses 100 position information and receivethe same. The mobile terminal 200 may determine whether a user iswearing the wearable glasses 100 based additionally on a result ofcomparing position information of the mobile terminal 200 with theposition information of the wearable glasses 100. In the examplediscussed above, when the temperature is similar to a body temperatureand when a position difference between the mobile terminal 200 and thewearable glasses 100 is within a threshold range, the mobile terminal200 may determine that the user who is carrying the mobile terminal 200is also wearing the wearable glasses 100.

Alternatively, according to an exemplary embodiment, when the wearableglasses 100 is found via short-range communication (e.g., Bluetooth,WFD, etc.) in addition to using the other requested information, themobile terminal 200 may determine that the user is wearing the wearableglasses 100.

According to an exemplary embodiment, when the user is wearing thewearable glasses 100, the mobile terminal 200 may transmit to thewearable glasses 100 a command for outputting the text message 1010received from the server 300 and a notification message 1020 notifyingarrival of the text message 1010 may be displayed on the display 1030.

In this case, the wearable glasses 100 may sense that a notificationevent for displaying the notification message 1020 notifying arrival ofthe text message 1010 (e.g., “You have a text message.”) has occurred.

FIG. 11 illustrates an example of sensing, by a wearable glasses, anoccurrence of a notification event by receiving advertisement content,according to another exemplary embodiment.

According to an exemplary embodiment, the wearable glasses 100 mayreceive advertisement content from a kiosk 1100 via short-rangecommunication. For example, when the wearable glasses 100 is locatedwithin a short-range communication radius of the kiosk 1100, thewearable glasses 100 may receive a mobile coupon broadcast from thekiosk 1100.

According to an exemplary embodiment, the wearable glasses 100 mayreceive advertisement content (e.g., mobile coupon) from the kiosk 1100via the mobile terminal 200. According to another exemplary embodiment,the wearable glasses 100 may receive advertisement coupon (e.g., mobilecoupon) directly from the kiosk 1100.

The wearable glasses 100 may sense that a notification event fordisplaying advertisement content 1110 received from the kiosk 1100 hasoccurred.

Hereinafter, an operation of the wearable glasses 100 to obtain movementinformation of a user will be described in detail.

FIG. 12 illustrates a flowchart of a method used by a wearable glassesto obtain movement information of a user, according to an exemplaryembodiment.

In operation S1210, the wearable glasses 100 may detect an occurrence ofa notification event.

Operation S1210 corresponds to S510 of FIG. 5A, and thus detaileddescription thereof will be omitted.

In operation S1220, the wearable glasses 100 may measure at least one ofacceleration information, tilt information, and position information byusing at least one sensor.

According to an exemplary embodiment, the wearable glasses 100 mayactivate at least one sensor that is in an inactive state when thewearable glasses 100 has detected the occurrence of the notificationevent. The wearable glasses 100 may measure the at least one ofacceleration information, tilt information, and position information byusing the at least one activated sensor.

For example, the wearable glasses 100 may measure a movement speed ofthe wearable glasses 100 by using an acceleration sensor. Alternativelyor additionally, the wearable glasses 100 may measure a variation in atilt of the wearable glasses 100 by using a tilt sensor. In this case,the wearable glasses 100 may determine whether a user who is wearing thewearable glasses 100 is moving and an amount of movement of the user,based on the variation in the tilt of the wearable glasses 100.

Alternatively or additionally, the wearable glasses 100 may obtainposition information of the user wearing the wearable glasses 100 byusing a position sensor. Examples of the position sensor may include aglobal positioning system (GPS) module or a Wi-Fi module, but are notlimited thereto.

For example, the wearable glasses 100 may obtain position information ofthe user wearing the wearable glasses 100 by using a GPS or a Wi-Fipositioning system (WPS). The GPS is a satellite navigation systemwhereby a present position of a user is calculated by receiving a signalsent from a satellite. The WPS is a technique in which a terminalreceives a parameter (e.g., a MAC address, a signal intensity, etc.) ofan RF signal emitted from a Wi-Fi access point (AP) and the terminalcalculates a position of a user is calculated based on the receivedparameter.

In operation S1230, the wearable glasses 100 may obtain movementinformation of a user based on at least one of acceleration information,tilt information, and position information, and determine a movementstate of the user based on the movement information. That is, thewearable glasses 100 may determine a movement state of a user based onat least one of acceleration information, tilt information, and positioninformation.

For example, when a user moves at the average speed of 4 km/h for aperiod of time, the wearable glasses 100 may determine that the user isin the movement state of walking. Alternatively, when the user is movingat the average speed of 20 km/h for a period of time, the wearableglasses 100 may determine that the user is in the movement state ofriding a bicycle.

Alternatively, when the average movement speed of the user for a periodof time is 0.0001 km/h, and the user is in an office for a period oftime, the wearable glasses 100 may determine that the user is in amovement state of being at work.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user by using the image sensor 161.For example, the wearable glasses 100 may determine whether the user isin a moving state or is in a resting state based on a variation of animage obtained by using the image sensor 161.

In operation S1240, the wearable glasses 100 may determine a method ofproviding notification content based on the determined movement state ofthe user. According to an exemplary embodiment, the wearable glasses 100may determine a time to provide notification content and a form ofproviding the notification content based on movement state of the user.Operation S1240 corresponds to operation S530 of FIG. 5, and thusdetailed description thereof will be omitted.

In operation S1250, the wearable glasses 100 may provide notificationcontent.

According to an exemplary embodiment, the wearable glasses 100 mayprovide notification content according to a time to provide notificationcontent and/or a form of providing notification content, determinedbased on movement state of the user. In the present specification,providing of notification content may include displaying notificationcontent, outputting notification content, replaying notificationcontent, and/or transmitting notification content to an external device.

For example, the wearable glasses 100 may provide notification contentat a present time or at a point when a certain event has occurred, basedon movement state of the user. The certain event may be predetermined.Also, the wearable glasses 100 may output the entire notificationcontent or a portion of notification content based on the determinedmovement state of the user.

The wearable glasses 100 may provide notification content via thedisplay 111 of the wearable glasses 100 based on movement state of theuser, or a user input, or via an external wearable device.

FIG. 13 illustrates a flowchart of a method used by a wearable glassesto obtain a movement state of a user from an external device, accordingto an exemplary embodiment.

In operation S1310, the wearable glasses 100 may detect an occurrence ofa notification event. Operation S1310 corresponds to operation S510 ofFIG. 5A, and thus detailed description thereof will be omitted.

In operation S1320, the wearable glasses 100 may request movementinformation of a user from an external device 1300. The external device1300 may be the mobile terminal 200 or the server 300, but is notlimited thereto.

According to an exemplary embodiment, the wearable glasses 100 mayactivate a communication interface when an occurrence of a notificationevent is detected. The wearable glasses 100 may request movementinformation of a user from an external device 1300. According to anexemplary embodiment, the wearable glasses 100 may transmit accelerationinformation, tilt information, and position information measured usingthe wearable glasses 100, to the external device 1300.

In operation S1330, the external device 1300 may obtain at least one ofacceleration information of the wearable glasses 100, positioninformation of the wearable glasses 100, and biometric information ofthe user wearing the wearable glasses 100.

According to an exemplary embodiment, the external device 1300 mayreceive from the wearable glasses 100 acceleration information measuredusing the wearable glasses 100, position information of the wearableglasses 100 or the like. The external device 1300 may also receiveacceleration information or position information or the like measured bya wearable device (e.g., a smart watch, a wig, shoes, etc.).

Also, when the external device 1300 is the mobile terminal 200 of theuser wearing the wearable glasses 100, the external device 1300 maymeasure acceleration and/or a position of the wearable glasses 100directly by using sensors.

According to an exemplary embodiment, the external device 1300 maycollect biometric information from at least one wearable deviceconnected to the external device 1300. For example, the external device1300 may receive pulse rate information, blood pressure information,heart rate information, body temperature information, sweat secretioninformation, respiratory rate information or the like measured by awearable device (e.g., a smart watch, ear rings, a ring, a necklace,glasses, shoes, clothes, etc.).

In operation S1340, the external device 1300 may analyze a movementstate of a user based on at least one of acceleration information,position information, and biometric information. That is, the externaldevice 1300 may determine a movement state of the user based on at leastone of acceleration information, position information, and biometricinformation.

For example, when an average pulse rate, an average respiratory rate, anamount of sweat secretion, and a body temperature of the user haveincreased for a period of time, the external device 1300 may determinethat the user is exercising. The period of time may be predetermined.Alternatively, when the user is staying at home for a period of time andbiometric information of the user changes little, the external device1300 may determine that the user is in a movement state of taking a restat home. When the user is moving at an average speed of 4 km/h in apark, the external device 1300 may determine that the user is in amovement state of taking a walk in the park.

In operation S1350, the external device 1300 may transmit the movementstate of the user to the wearable glasses 100. The external device 1300may transmit the movement state of the user to the wearable glasses 100via at least one of short-range communication, mobile communication, andwireless communication. For example, the external device 1300 maytransmit movement state information, movement speed information, andposition information of the user to the wearable glasses 100. In thiscase, in operation S1360, the wearable glasses 100 may obtain themovement state of the user from the external device 1300.

In operation S1370, the wearable glasses 100 may determine a method ofproviding notification content based on the movement state of a user.For example, the wearable glasses 100 may determine a time to providenotification content and a form of providing the notification content.

In operation S1380, the wearable glasses 100 may provide notificationcontent. For example, when the user is in a movement state of taking awalk, the wearable glasses 100 may output a portion of the notificationcontent, and may output the entire notification content when the user isin a movement state of taking a rest at home.

Operations S1370 and S1380 respectively correspond to operations S1240and S1250 of FIG. 12, and thus detailed description thereof will beomitted.

Hereinafter, an operation of the wearable glasses 100 to determine atime to provide notification content based on a movement state of auser, will be described in detail with reference to FIG. 14.

FIG. 14 illustrates a flowchart of a method used by a wearable glassesto determine a time to output content corresponding to a notificationevent based on a movement speed of a user, according to an exemplaryembodiment.

In operation S1410, the wearable glasses 100 may detect an occurrence ofa notification event.

In operation S1420, the wearable glasses 100 may obtain movementinformation of a user when detecting occurrence of a notification event.

In operation S1430, the wearable glasses 100 may determine whether amovement speed of the user is less than a threshold speed based on theobtained movement information of the user. The threshold speed may bepreset by the user or a system. The threshold speed may be determined,for example, based on an average movement speed of the user.

For example, the wearable glasses 100 may determine whether a movementspeed of the user is 4 km/h, which is an average walking speed.

When the movement speed of the user is less than the threshold speed(S1430, YES), the wearable glasses 100 may determine to outputnotification content in operation S1440.

For example, when the movement speed of the user is less than 4 km/hwhich is the average walking speed, the wearable glasses 100 maydetermine to output notification content at a present time. The presenttime may be within a threshold period from a point when the wearableglasses 100 has detected the occurrence of a notification event (forexample, within 30 seconds). The threshold period may be predetermined.

In operation S1450, the wearable glasses 100 may output notificationcontent at the present time. For example, the wearable glasses 100 mayreplay notification content at the present time when the notificationcontent is video content or audio content. The wearable glasses 100 maydisplay notification content at the present time when notificationcontent is still image content or text content.

On the other hand, when the movement speed is greater than or equal tothe threshold speed (S1430, NO), the wearable glasses 100 may determineto output notification content at a different time in operation S1460.The different time may be preset, and may be for example a later time.

The different time may indicate previously set time (e.g., 10 pm).Alternatively, the different time may indicate a time when a certainevent has occurred. The certain event may be predetermined. The certainevent may include at least one of an event of receiving a user inputrequesting to output notification content, an event whereby a presettime passes, and an event for changing a movement state of the user, butis not limited thereto.

For example, the wearable glasses 100 may determine a point whennotification content is output as a point when an input requesting tooutput notification content is received. The input may be predetermined.Also, the wearable glasses 100 may determine a point when notificationcontent is output, as a point when a movement speed of the user becomesless than a threshold speed.

In operation S1470, the wearable glasses 100 may not output notificationcontent at the present time. Alternatively or additionally, the wearableglasses 100 may display an indicator indicating that a notificationevent has occurred.

According to an exemplary embodiment, when the user wearing the wearableglasses 100 is moving at a threshold speed or higher, the wearableglasses 100 may display no notification content and/or may display asimple indicator indicating that a notification event has occurred inorder not to obstruct the user's view or distract the user. An operationof the wearable glasses 100 to determine a time to provide notificationcontent based on a movement state of the user will be described in moredetail with reference to FIGS. 15A and 15B.

FIGS. 15A and 15B illustrate diagrams for describing an example ofadjusting, by a wearable glasses, a time and a method to output contentcorresponding to a notification event based on a movement speed of auser, according to an exemplary embodiment.

Referring to FIG. 15A, while a user 1510 is crossing a pedestriancrossing, the wearable glasses 100 may receive a push message includingnews content from the server 300. In this case, the wearable glasses 100may sense that a notification event for displaying news content (e.g.,“Sochi Olympics, Yuna Kim, Silver medal!”) has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user 1510 before displaying the newscontent and determine whether a movement speed of the user 1510 is lessthan a threshold speed (e.g., 2 km/h). For example, as the user 1510 iscrossing a pedestrian crossing, a movement speed of the user 1510 may be3 km/h. In this case, the wearable glasses 100 may determine not tooutput news content at a present time as the movement speed of the user1510 (e.g., 3 km/h) is equal to or greater than the threshold speed (2km/h). The wearable glasses 100 may display a simple indicator 1511indicating occurrence of the notification event.

According to an exemplary embodiment, the wearable glasses 100 maydetermine not to display news content while the user 1510 is crossing apedestrian crossing but may instead display the indicator 1511, therebyminimizing obstruction of the view of the user 1510.

Referring to FIG. 15B, while a user 1520 wearing the Wearable glasses100 is sitting and taking a rest at home, the Wearable glasses 100 mayreceive a push message including news content from the server 300. Inthis case, the wearable glasses 100 may sense that a notification eventfor displaying news content 1521 has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user 1520 before displaying the newscontent 1521, and determine whether a movement speed of the user 1520 isless than a threshold speed (e.g., 2 km/h). For example, as the user1520 is taking a rest at home, the movement speed of the user 1520 maybe about 0 km/h. In this case, the wearable glasses 100 may determine tooutput the news content 1521 at a present time as the movement speed ofthe user 1520 (e.g., 0 km/h) is less than the threshold speed (2 km/h).

The wearable glasses 100 may display the news content 1521 (for example,“Sochi Olympics, Silver medal for Yuna Kim! Figure skater Yuna Kim haswon a valuable silver medal at the Sochi Olympics!”) in the form of AR,MR, or VR. In this case, the user 1520 may safely check the news content1521 via the wearable glasses 100 even though the view of the user 1520may be obstructed.

Hereinafter, an operation of the wearable glasses 100 to determine anoutput form of notification content based on movement information of auser will be described in detail with reference to FIG. 16.

FIG. 16 illustrates a flowchart of a method of determining an outputform of content corresponding to a notification event based on movementinformation of a user, according to an exemplary embodiment.

In operation S1610, the wearable glasses 100 may detect occurrence of anotification event. In operation S1620, the wearable glasses 100 mayobtain movement information of a user. Operations S1610 and 1620respectively correspond to operations S1410 and S1420 of FIG. 14, andthus detailed description thereof will be omitted.

In operation S1630, the wearable glasses 100 may determine whether amovement speed of the user is less than a first threshold speed. Thefirst threshold speed may be a reference speed used to determine whetherto output content. The first threshold speed may be preset by the useror by a system.

For example, when the first threshold speed is 10 km/h, the wearableglasses 100 may determine whether a movement speed of the user is lessthan 10 km/h based on movement information of the user.

When the movement speed of the user is equal to or greater than thefirst threshold speed (S1630, NO), the wearable glasses 100 may notoutput notification content at a present time, in operation S1640. Forexample, when the user wearing the wearable glasses 100 is riding amotorcycle, the movement speed of the user may be equal to or greaterthan the first threshold speed. The wearable glasses 100 may not outputnotification content in order not to obstruct the user's view.

On the other hand, when the movement speed of the user is less than thefirst threshold speed (S1630, YES), the wearable glasses 100 maydetermine whether a movement speed of the user is between the firstthreshold speed and a second threshold speed in operation S1650. Thesecond threshold speed may be a reference speed for determining whetherto output the entire notification content or a portion of notificationcontent. The second threshold speed may be preset by the user or asystem. Also, according to an exemplary embodiment, the first thresholdspeed and the second threshold speed may be determined based on a normalmovement speed of the user.

According to an exemplary embodiment, when the first threshold speed is10 km/h, and the second threshold speed is 2 km/h, the wearable glasses100 may determine whether a movement speed of the user is between 10km/h and 2 km/h based on movement information of the user.

When the movement speed of the user is between the first threshold speedand the second threshold speed (S1650, YES), the wearable glasses 100may output a portion of notification content in operation S1660. Aportion of notification content may include at least one of a keyword,summary information, and a title of the notification content, but is notlimited thereto.

For example, when the movement speed of the user is between the firstthreshold speed and the second threshold speed, the wearable glasses 100may extract at least one of a keyword, summary information, and a titleof the notification content by using metadata of the notificationcontent. Then, the wearable glasses 100 may provide the at least one ofa keyword, summary information, and a title of the notification content.

On the other hand, when the movement speed of the user is not betweenthe first threshold speed and the second threshold speed (S1650, NO),the wearable glasses 100 may output the entire notification content whena movement speed of the user is less than the second threshold speed, inoperation S1670.

For example, when the user wearing the wearable glasses 100 is reading abook at home, a movement speed of the user may be less than the secondthreshold speed. In this case, the wearable glasses 100 may output theentire notification content.

Hereinafter, an example where the wearable glasses 100 determines anoutput form of notification content based on movement information of auser will be described in detail with reference to FIGS. 17 through 19.

FIGS. 17 through 19 illustrate diagrams for describing an example ofproviding, by a wearable glasses, a portion of content or entire contentcorresponding to a notification event based on a movement speed of auser, according to exemplary embodiments.

An example where the user wearing the wearable glasses 100 is riding abicycle will be described with reference to FIG. 17.

In operation S1710, the wearable glasses 100 may receive a push messageincluding news content 1000 from the server 300.

In operation S1720, the wearable glasses 100 may determine whether amovement speed of the user is greater than a first threshold speed(e.g., 15 km/h) based on movement information of the user. As the useris riding a bicycle, an average movement speed of the user may be 18km/h.

In operation S1730, the wearable glasses 100 may determine not to output(1700) the news content 1000 as a movement speed of the user (18 km/h)is greater than the first threshold speed (e.g., 15 km/h).

In regard to FIG. 18, an example where the user wearing the wearableglasses 100 is taking a walk with a dog will be described.

In operation S1810, the wearable glasses 100 may receive a push messageincluding the news content 1000 from the server 300.

In operation S1820, the wearable glasses 100 may determine whether amovement speed of the user is between the first threshold speed (e.g.,15 km/h) and the second threshold speed (e.g., 2 km/h) based on movementinformation of the user. As the user is taking a walk, an averagemovement speed of the user may be 2.5 km/h.

In operation S1830, as the movement speed of the user (2.5 km/h) isbetween the first threshold speed (e.g., 15 km/h) and the secondthreshold speed (e.g., 2 km/h), the wearable glasses 100 may determineto output a portion of the news content 1000. For example, the wearableglasses 100 may extract a headline 1800 (e.g., “Yuna Kim, silvermedal!”) from the news content 1000, and provide the headline 1800 inthe form of AR.

In regard to FIG. 19, an example where the user wearing the wearableglasses 100 is at work in an office will be described.

In operation S1910, the wearable glasses 100 may receive a push messageincluding the news content 1000 from the server 300.

In operation S1920, the wearable glasses 100 may determine whether amovement speed of the user is less than the second threshold speed(e.g., 2 km/h) based on movement information of the user. As the user issitting at a desk in an office, the movement speed of the user may be 0km/h.

In operation S1930, as the movement speed of the user (0 km/h) is lessthan the second threshold speed (e.g., 2 km/h), the wearable glasses 100may determine to output the entire news content 1000. For example, thewearable glasses 100 may provide the entire news article 1900 includedin the news content 1000 in an AR form.

FIG. 20 illustrates a flowchart of a method used by a wearable glassesto output non-output content when a certain event has occurred,according to an exemplary embodiment.

In operation S2010, the wearable glasses 100 may detect occurrence of anotification event.

In operation S2020, the wearable glasses 100 may obtain movementinformation of the user when detecting occurrence of the notificationevent.

In operation S2030, the wearable glasses 100 may determine whether amovement speed of the user is less than a threshold speed based on themovement information of the user. For example, the wearable glasses 100may determine whether a movement speed of the user is less than 4 km/hwhich is the average walking speed.

When the movement speed of the user is equal to or greater than athreshold speed (S2030, NO), the wearable glasses 100 may not outputnotification content or may output a portion of the notificationcontent. Here, according to an exemplary embodiment, when the movementspeed of the user is equal to or greater than the threshold speed, thewearable glasses 100 may determine to output notification content at apoint when a certain event has occurred. The certain event may bepredetermined.

The certain event may include at least one of an event for receiving auser input for requesting to output notification content, an eventwhereby a preset time passes, and an event for changing a movement stateof a user, but is not limited thereto. For example, the wearable glasses100 may determine a point when a movement speed of the user becomes lessthan the threshold speed as a time to output notification content.

In operation S2050, the wearable glasses 100 may store non-outputnotification content or notification content including a portion whichis output in a list of non-output notification content.

In operation S2060, the wearable glasses 100 may determine whether acertain event has occurred. When the certain event has not occurred(S2060, NO), the wearable glasses 100 may continuously not outputnotification content.

On the other hand, when the certain event has occurred (S2060, YES), thewearable glasses 100 may output the entire notification content inoperation S2070. For example, when an event for changing a movementstate of a user occurs, the wearable glasses 100 may output the entirenotification content that has not been output yet or may output aremaining portion of a portion which has been output.

When notification content is video content or audio content, thewearable glasses 100 may replay the notification content. Whennotification content is still image content or text content, thewearable glasses 100 may display notification content at a present time.

Hereinafter, an operation of the wearable glasses 100 to outputnon-output content when a certain event has occurred will be describedin detail with reference to FIG. 21.

FIG. 21 illustrates an example of outputting, by a wearable glasses,content corresponding to a previously occurred notification event basedon a movement change event of a user.

Referring to 2110 of FIG. 21, while a user wearing the wearable glasses100 is riding a bicycle, the wearable glasses 100 may receive a pushmessage including news content 2121 from the server 300. In this case,the wearable glasses 100 may detect that a notification event fordisplaying news content 2121 has occurred.

The wearable glasses 100 may determine whether a movement speed of theuser is greater than a threshold speed (e.g., 15 km/h) based on movementinformation of the user. The user is riding a bicycle, and thus anaverage movement speed of the user may be 18 km/h.

As the movement speed of the user (18 km/h) is greater than thethreshold speed (e.g., 15 km/h), the wearable glasses 100 may not outputnews content 2121 at a present time (2111), and may determine to outputnews content 2121 when a certain event occurs. The certain event may bea point when the movement speed of the user becomes 2 km/h or less.

Referring to 2120 of FIG. 21, when the user wearing the wearable glasses100 has stopped riding a bicycle, the wearable glasses 100 may detectthat a certain event whereby a movement speed becomes 2 km/h or less hasoccurred.

The wearable glasses 100 may provide news content 2121 that is notoutput yet as a certain event is sensed. For example, the wearableglasses 100 may display the news content 2121 in the form of AR.

According to an exemplary embodiment, the wearable glasses 100 providesnotification content when a movement speed of the user becomes a certainlevel or less, thereby preventing the user from being exposed to adangerous situation.

FIG. 22 illustrates a diagram for describing a method used by a wearableglasses that changes an output form of content based on a certain inputby a user, according to an exemplary embodiment.

In operation S2210, the wearable glasses 100 may detect occurrence of anotification event.

In operation S2220, the wearable glasses 100 may obtain movementinformation of a user when detecting occurrence of a notification event.

In operation S2230, the wearable glasses 100 may output a portion ofnotification content based on movement information of the user. Forexample, the wearable glasses 100 may output a portion of notificationcontent when it is determined that the user is walking the street.

In operation S2240, the wearable glasses 100 may determine whether afirst user input for requesting to output the entire notificationcontent is received or not.

According to an exemplary embodiment, examples of a first user input forrequesting to output the entire content may vary. For example, the firstuser input may be at least one of a motion input, a touch input, a keyinput, a voice input, and a multiple input, but is not limited thereto.

According to an exemplary embodiment, the first user input forrequesting to output the entire notification content may be preset. Forexample, a head up motion may be set as the first user input forrequesting to output the entire content.

When the first user input for requesting to output the entirenotification content is received (S2240, YES), the wearable glasses 100may output the entire notification content in response to the first userinput in operation S2250. For example, the wearable glasses 100 mayreplay the entire notification content when the notification content isvideo content or audio content. The wearable glasses 100 may display theentire notification content in the form of AR when the notificationcontent is still image content or text content.

On the other hand, when the first user input for requesting to outputthe entire notification content is not received (S2240, NO), wearableglasses 100 may determine whether a second user input for requestingblocking of the output of the portion of the notification content hasbeen received in operation S2260.

According to an exemplary embodiment, examples of the second user inputfor requesting blocking of partial output of notification content mayvary. For example, the second user input may be at least one of a motioninput, a touch input, a key input, a voice input, and a multiple input,but is not limited thereto.

According to an exemplary embodiment, a second user input for requestingblocking of partial output of notification content may be preset. Forexample, a user may set a shaking motion of shaking the head to the leftand the right as the second user input for requesting blocking ofpartial output of notification content.

When the second user input for requesting to block output of a portionof the notification content is received (S2260, YES), the wearableglasses 100 may block partial output of notification content accordingto the second user input in operation S2270. In the presentspecification, ‘blocking output’ may indicate that an outputtingcondition is ended. For example, when the wearable glasses 100 blocksoutput of notification content, the notification content that wasdisplayed in front of the eyes of the user may disappear or a soundsignal may not be output anymore.

On the other hand, when the second user input for requesting to blockoutput of a portion of the notification content is not received (S2260,NO), the wearable glasses 100 may wait for a certain amount of time topass in operation S2280. When no additional user input is received aftera certain period of time passes, the wearable glasses 100 may block theoutput of the portion of the notification content in operation S2270.For example, when a first user input requesting output of the entirenotification content is not received after a portion of the notificationcontent has been output, the wearable glasses 100 may not output aportion of the notification content anymore. That is, the user maydecide that it is acceptable to output the entire content, oralternatively, the user may decide to quickly block the output of theportion of the notification or to take no action in which case theoutput of the portion of the notification is blocked after a certaintime period has passed.

Hereinafter, an example of modifying, by the wearable glasses 100, anoutput form of content based on a certain input of a user will bedescribed with reference to FIGS. 23 and 24.

FIGS. 23 and 24 illustrate diagrams for describing an example ofoutputting, by a wearable glasses, entire content based on a head upmotion of a user. In regard to FIGS. 23 and 24, an example where a userinput for requesting to output the entire content is a head up motionwill be described.

Referring to 2310 of FIG. 23, while a user wearing the wearable glasses100 is crossing a pedestrian crossing, the wearable glasses 100 mayreceive a push message including news content from the server 300. Inthis case, the wearable glasses 100 may detect that a notification eventfor displaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of a user before displaying the newscontent. For example, the wearable glasses 100 may determine that theuser is moving at a speed of 3 km/h as discussed previously.

As the user is moving, the wearable glasses 100 may output a portion2311 of the news content in order not to obstruct the user's view. Forexample, the wearable glasses 100 may extract a headline from the newscontent and output the extracted headline. In this case, the user maycheck the headline of the news content while crossing a pedestriancrossing.

According to an exemplary embodiment, after checking the headline of thenews content, in order to view the entire news content 2321, the usermay stop and look up to the sky after completely crossing the pedestriancrossing.

In this case, the wearable glasses 100 may sense a head up motion 2300of the user while outputting the portion 2311 of the news content (e.g.,a headline). For example, the wearable glasses 100 may sense the head upmotion 2300 of the user via a tilt sensor, an acceleration sensor, agyroscope sensor or the like, as described previously.

Referring to 2320 of FIG. 23, the wearable glasses 100 may output theentire news content 2321 according to the head up motion 2300 of theuser. In this case, the user may safely check the entire news content2321.

According to another exemplary embodiment, in order to prevent output ofthe entire news content 2321 regardless of the user's intention, thewearable glasses 100 may output the entire news content 2321 only when atime period of the head up motion 2300 is equal to or greater than athreshold time. For example, the wearable glasses 100 may measure a timeperiod of the head up motion 2300 when the head up motion 2300 of theuser is sensed. The wearable glasses 100 may output the entire newscontent 2321 when the time period of the head up motion 2300 is equal toor greater than a threshold time (e.g., two seconds). That is, in orderto prevent the inadvertent output of the entire content when, forexample, the user looks up at plane or bird in the sky, the wearableglasses 100 may check to ensure that the head up motion 2400 is anintended motion for viewing the entire content.

Referring to 2410 of FIG. 24, while the user wearing the wearableglasses 100 is crossing a pedestrian crossing, the wearable glasses 100may receive a push message including advertisement content. In thiscase, the wearable glasses 100 may sense that a notification event fordisplaying advertisement content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying theadvertisement content. For example, the wearable glasses 100 maydetermine that the user is moving at a speed of 3 km/h.

As the user is moving, in order not to obstruct the user's view much,the wearable glasses 100 may output a portion of the advertisementcontent. For example, the wearable glasses 100 may display a thumbnailimage 2411 of the advertisement content. In this case, the user maydetermine that the advertisement content is received while crossing thepedestrian crossing.

According to an exemplary embodiment, the user may stop after completelycrossing the pedestrian crossing and loop up to the sky in order to viewthe entire advertisement content 2421 after checking the thumbnail 2411of the advertisement content. In this case, the wearable glasses 100 maysense the head up motion 2400 while outputting a portion of theadvertisement content (e.g., the thumbnail image 2411). For example, thewearable glasses 100 may sense the head up motion 2400 by using a tiltsensor, an acceleration sensor, a gyroscope sensor or the like.

Referring to 2420 of FIG. 24, the wearable glasses 100 may output theentire advertisement content 2421 according to the head up motion 2400of the user. In this case, the user may check the entire advertisementcontent 2421 in a safe condition.

According to another exemplary embodiment, in order to prevent that theentire advertisement content 2421 is output regardless of the user'sintention, the wearable glasses 100 may output the entire advertisementcontent 2421 only when a time period of the head up motion 2400 is equalto or greater than a threshold time (e.g., three seconds). That is, inorder to prevent the inadvertent output of the entire content when, forexample, the user looks up at plane or bird in the sky, the wearableglasses 100 may check to ensure that the head up motion 2400 is anintended motion for viewing the entire content.

FIG. 25 illustrates a diagram for describing an example of blocking, bya wearable glasses which has output a portion of content, output of thecontent based on a user input. In regard to FIG. 25, an example where auser input for requesting to block output of content is a shaking motionwill be described.

Referring to 2510 of FIG. 25, while a user wearing the wearable glasses100 is crossing a pedestrian crossing, the wearable glasses 100 mayreceive a push message including news content from the server 300. Inthis case, the wearable glasses 100 may detect that a notification eventfor displaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the newscontent. For example, the wearable glasses 100 may determine that theuser is moving at a speed of 3 km/h.

As the user is moving, in order not to obstruct the user's view much,the wearable glasses 100 may output a portion 2511 of the news content(e.g., a headline). The user may check a headline of the news contentwhile crossing the pedestrian crossing.

According to an exemplary embodiment, after checking the headline of thenews content, if the user does not wish to view the news content, theuser may shake the head to the left and the right. In this case, thewearable glasses 100 may sense a shaking motion 2500 of the user whileoutputting the portion 2511 of the news content (e.g., a headline). Forexample, the wearable glasses 100 may sense the shaking motion 2500 ofshaking the head to the left and the right a certain number of times(e.g., twice) by using a tilt sensor, an acceleration sensor, agyroscope sensor or the like, as previously described.

Referring to 2520 of FIG. 25, the wearable glasses 100 may not displaythe portion 2511 of the news content (e.g., a headline) anymore based onthe shaking motion 2500 of the user. According to an exemplaryembodiment, the wearable glasses 100 may add the news content to a listof non-output contents, as previously described.

Although a motion input is described as an example of a user input withreference to FIGS. 23 through 25, the embodiments are not limitedthereto. For example, the user may input to the wearable glasses 100voice for requesting to output the entire notification content or voicefor requesting to block output of notification content or may select abutton included in the wearable glasses 100 to request or block output.

FIG. 26 illustrates a flowchart of a method used by a wearable glassesto highlight a keyword in content corresponding to a notification event,according to an exemplary embodiment.

In operation S2610, the wearable glasses 100 may detect occurrence of anotification event.

In operation S2620, the wearable glasses 100 may obtain movementinformation of a user when detecting occurrence of a notification event.

In operation S2630, the wearable glasses 100 may determine to highlighta keyword in notification content based on movement information of theuser.

For example, based on movement information of the user, when a movementspeed of the user is equal to or greater than a threshold speed (e.g., 4km/h), the wearable glasses 100 may extract keywords from notificationcontent. According to an exemplary embodiment, information aboutkeywords may be stored in metadata of the notification content.

According to an exemplary embodiment, the wearable glasses 100 mayhighlight keywords in the notification content. For example, thewearable glasses 100 may adjust sizes or colors of keywords or mayunderline the keywords. An operation of the wearable glasses 100 tohighlight keywords in notification content will be described in moredetail with reference to FIG. 27.

FIG. 27 illustrates a diagram for describing an example of highlighting,by a wearable glasses, a keyword in content based on movementinformation of a user, according to an exemplary embodiment.

Referring to 2700-1 of FIG. 27, the wearable glasses 100 may receive apush message including news content from the server 300. In this case,the wearable glasses 100 may detect that a notification event fordisplaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the newscontent. For example, when an average movement speed of the user is0.0001 km/h for a period of time and the user is in an office for aperiod of time, the wearable glasses 100 may determine that the user issitting on a chair and working. The periods of time may bepredetermined.

When the user is sitting on a chair and working, since this situation isnot dangerous even if the user's view is obstructed, the wearableglasses 100 may output the entire news content 2710 (e.g., “At the SochiOlympics, Yuna Kim achieved 70.2 points, less by only 0.6 points thanthe gold medalist, and unfortunately achieved just the silver medal.”received from the server 300 at a present time.

Referring to 2700-2 of FIG. 27, while a user wearing the wearableglasses 100 is taking a walk, the wearable glasses 100 may receive apush message including news content from the server 300. In this case,the wearable glasses 100 may detect that a notification event fordisplaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of a user before displaying the newscontent. For example, the wearable glasses 100 may determine that theuser is moving at an average speed of 3 km/h for a period of time.

When the user is moving at a threshold speed (e.g., 2 km/h) or greater,since the user is not able to concentrate on the entire news content2710 (e.g., “At the Sochi Olympics, Yuna Kim achieved 70.2 points, lessby only 0.6 points than the gold medalist, and unfortunately achievedjust the silver medal.”), the wearable glasses 100 may extract keywordsincluded in the news content and highlight the keywords.

For example, the wearable glasses 100 may extract ‘Yuna Kim,’ SochiOlympics,′ and ‘silver medal’ from the news content as keywords andadjust the size, thickness, and color of Yuna Kim,′ Sochi Olympics,′ and‘silver medal.’

FIG. 28 illustrates a flowchart of a method used by a wearable glassesto adjust a transparency of content corresponding to a notificationevent, according to an exemplary embodiment.

In operation S2810, the wearable glasses 100 may obtain movementinformation of a user when a notification event has occurred.

In operation S2820, the wearable glasses 100 may determine whether theuser wearing the wearable glasses 100 is driving or not, based onmovement information of the user.

According to an exemplary embodiment, the wearable glasses 100 maymeasure a movement speed of the user by using an acceleration sensorincluded in the wearable glasses 100. The wearable glasses 100 maydetermine that the user is driving if the user is moving at 80 km/h.

According to an exemplary embodiment, the wearable glasses 100 maydetermine whether a user is driving or not, based on accelerationinformation received from the mobile terminal 200 connected to thewearable glasses 100 or a navigation device included in a car.

According to an exemplary embodiment, when the user sets an operatingmode of the wearable glasses 100 to a navigation mode, the wearableglasses 100 may determine that the user is driving.

In operation S2830, when it is determined that the user is driving, thewearable glasses 100 may set a transparency of notification content. Forexample, when it is determined that the user is driving, the wearableglasses 100 may display the notification content by setting atransparency of the notification content to 50%.

According to an exemplary embodiment, the Wearable glasses 100 mayadjust a transparency of notification content based on a driving speed.For example, the wearable glasses 100 may increase a transparency ofnotification content to become more transparent as the driving speedincreases.

FIG. 29 illustrates a diagram illustrating an example of a wearableglasses that adjusts a transparency of content based on speedinformation of a user when the user is driving, according to anexemplary embodiment.

Referring to 2910 of FIG. 29, the user wearing the wearable glasses 100may receive a push message including news content from the server 300.In this case, the wearable glasses 100 may detect that a notificationevent for displaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the newscontent. For example, the wearable glasses 100 may determine that anaverage movement speed of the user is 0 km/h during a period of time.The period of time may be predetermined.

As the user is in a standstill state, the wearable glasses 100 may set atransparency of the news content to 0% and thus display opaque newscontent 2911.

Referring to 2920 of FIG. 29, on the other hand, while the user wearingthe wearable glasses 100 is driving, the wearable glasses 100 mayreceive a push message including news content from the server 300. Inthis case, the wearable glasses 100 may detect that a notification eventfor displaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the newscontent. For example, the wearable glasses 100 may determine that anaverage movement speed of the user during a period of time is 80 km/hand that the user is driving.

As the user is in a driving state, the wearable glasses 100 may set atransparency of the news content to 50% and display semi-transparentnews content 2921.

According to an exemplary embodiment, the wearable glasses 100 mayadjust a transparency of notification content to prevent obstruction ofthe view of the user who is driving.

FIG. 30 illustrates a diagram for describing a method used by a wearableglasses to determine a form of an output signal based on environmentinformation, according to an exemplary embodiment.

In operation S3010, the wearable glasses 100 may detect occurrence of anotification event.

In operation S3020, the wearable glasses 100 may obtain environmentinformation about an environment within a certain distance from thewearable glasses 100. The certain distance may be predetermined.Environment information may include at least one of information aboutexternal sounds generated within a certain distance from the wearableglasses 100 and information about an external image obtained using theimage sensor 161.

For example, the wearable glasses 100 may capture an image of thesurroundings by using the image sensor 161. The image sensor 161 may bemounted near the eyes of the user when the user wears the wearableglasses 100 so as to capture an image similar to an image recognized bythe eyes of the user. The wearable glasses 100 may analyze a capturedimage to obtain information about an external image. For example, thewearable glasses 100 may obtain object information, edge information,atmosphere information, and color information included in a capturedimage.

The wearable glasses 100 may detect surrounding sounds via a microphone.The wearable glasses 100 may analyze detected surrounding sounds toobtain external sound information. For example, the wearable glasses 100may obtain information about an amount of surrounding noise, informationon whether there are multiple voices or the like.

The wearable glasses 100 may also obtain environment information aboutan environment within a certain distance from another wearable device ofthe user wearing the wearable glasses 100 existing within a radius ofshort-range communication or from the mobile terminal 200. For example,when the mobile terminal 200 has obtained information about an externalimage by analyzing an image captured using a necklace, the wearableglasses 100 may receive the information about an external image from themobile terminal 200.

Also, the wearable glasses 100 may receive information about an externalsound obtained using the mobile terminal 200 or a watch, from the mobileterminal 200 or the watch.

In operation S3030, the wearable glasses 100 may determine an outputsignal form of notification content by considering environmentinformation.

According to an exemplary embodiment, the wearable glasses 100 maydetermine to provide notification content in the form of at least one ofan audio signal and a video signal, by considering environmentinformation. For example, when a level of surrounding noise is equal toor greater than a threshold value or a plurality of voices are detected,the wearable glasses 100 may determine to output notification content inthe form of a video signal. Also, when edges that are more than acertain number are detected from a captured image, the wearable glasses100 may determine to output notification content in the form of an audiosignal. The certain number may be a predetermined number.

In operation S3040, the wearable glasses 100 may output notificationcontent in the form of the determined output signal form. This operationwill be described with reference to FIGS. 31 and 32.

FIGS. 31 and 32 illustrate diagrams illustrating an example ofadjusting, by a wearable glasses, a form of an output signal based onexternal sound information, according to an exemplary embodiment.

Referring to 3110 of FIG. 31, while a user wearing the wearable glasses100 is waiting for a train, the wearable glasses 100 may receive a pushmessage including news video content 3101 from the server 300. In thiscase, the wearable glasses 100 may detect that a notification event fordisplaying the news video content 3101 has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the news videocontent 3101. For example, the wearable glasses 100 may determine thatan average movement speed of the user for a period of time is 0 km/h andthat the user is in a standstill state.

As the user is in a standstill state, the wearable glasses 100 maydetermine to output the news video content 3101. The wearable glasses100 may further include information about an environment within acertain distance therefrom. For example, the wearable glasses 100 mayactivate a microphone to detect surrounding sounds. As level of thesurrounding sounds is equal to a threshold value or less (e.g., 70 dB),the wearable glasses 100 may replay the news video content 3101.

Referring to 3120 of FIG. 31, a subway train is coming in to theplatform, and thus, the level of the surrounding sounds (e.g., 85 dB)may be greater than a threshold value (e.g., 70 dB). In this case, thewearable glasses 100 may convert an audio signal of the news videocontent 3101 to a text signal and display the text signal.

For example, the wearable glasses 100 may convert voice included in thenews video content 3101 to text based on a speech to text (STT)technique to thereby generate a transcript 3102 corresponding to thenews video content 3101. In the present specification, a transcript mayrefer to a record including text converted from speech.

According to an exemplary embodiment, when surrounding sounds are equalto or greater than a threshold value, the wearable glasses 100 mayprovide a transcript corresponding to audio content so that the user mayvisually recognize notification content.

Referring to 3210 of FIG. 32, while the user wearing the wearableglasses 100 is sitting and reading a book in a park, the wearableglasses 100 may receive a push message including news video content 3201from the server 300. In this case, the wearable glasses 100 may detectthat a notification event for displaying the news video content 3201 hasoccurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the news videocontent 3201. For example, the wearable glasses 100 may determine thatan average movement speed of the user during a period of time is 0 km/hand that the user is in a standstill state.

As the user is in a standstill state, the wearable glasses 100 maydetermine to output the news video content 3201. The wearable glasses100 may further include environment information about an environmentwithin a certain distance therefrom. For example, the wearable glasses100 may activate a microphone to detect surrounding sounds.

As the level of the surrounding sounds is equal to a threshold value orless (e.g., 70 dB), the wearable glasses 100 may replay the news videocontent 3201.

Referring to 3220 of FIG. 32, as the user wearing the wearable glasses100 is having conversation with another person, the wearable glasses maydetect multiple voices. When multiple voices are detected, if the HMSapparatus 100 replays the news video content 3201, the replaying maydisturb the conversation, and thus, the HMS apparatus 100 may convert anaudio signal of the news video content 3201 to a text signal and displaythe text signal. For example, the wearable glasses 100 may convert voiceincluded in the news video content 3201 to a text 3202 based on a STTtechnique and display the text 3202.

FIG. 33 illustrates a flowchart of a method used by a wearable glassesto determine an output form of content corresponding to a notificationevent based on external image information, according to an exemplaryembodiment.

In operation S3310, the wearable glasses 100 may detect occurrence of anotification event.

In operation S3320, the wearable glasses 100 may obtain informationabout an external image by using the image sensor 161 included in thewearable glasses 100.

The information about an external image may include at least one ofvariation information about a variation of the external image, colorinformation of the external image, and object information about objectsincluded in the external image, but is not limited thereto.

According to an exemplary embodiment, the wearable glasses 100 mayobtain information about an external image by analyzing the externalimage captured using the image sensor 161.

According to another exemplary embodiment, the wearable glasses 100 mayrequest analysis of an external image while transmitting the capturedexternal image to the mobile terminal 200 or the server 300. Thewearable glasses 100 may receive from the mobile terminal 200 or theserver 300 at least one of variation information of the external image,color information of the external image, and object information aboutobjects included in the external image.

In operation S3330, the wearable glasses 100 may determine an outputform of notification content based on the information about an externalimage.

According to an exemplary embodiment, the wearable glasses 100 maydetermine to provide notification content in at least one of an audiosignal and a video signal based on information about an external image.For example, when more edges than a threshold number of edges aredetected from a captured image or a variation of a captured image isequal to or greater than a threshold value, the wearable glasses 100 maydetermine to output notification content in the form of an audio signal.The threshold number of edges may be preset.

According to an exemplary embodiment, the wearable glasses 100 maydetermine to output a portion of or the entire notification contentbased on information about an external image. For example, when moreedges than a threshold number are detected in the captured image or avariation of a captured image is equal to or greater than a thresholdvalue, the wearable glasses 100 may determine to output a portion ofnotification content. A portion of notification content may include atleast one of a keyword, summary information, and a title of thenotification content, but is not limited thereto.

In operation S3340, the wearable glasses 100 may output notificationcontent in the determined output form. For example, the wearable glasses100 may provide notification content in the form of at least one of anaudio signal and a video signal. The wearable glasses 100 may firstoutput a portion of notification content and then may output the entirenotification content when a user input for outputting the entirenotification content is received.

An operation of the wearable glasses 100 to output notification contentin different forms based on information about an external image will bedescribed in detail with reference to FIG. 34.

FIG. 34 illustrates an example of adjusting, by a wearable glasses, aform of an output signal based on external image information, accordingto an exemplary embodiment.

Referring to 3410 of FIG. 34, while a user wearing the wearable glasses100 stops and looks up to the sky, the wearable glasses 100 may receivea push message including news content 3401 from the server 300. Thewearable glasses 100 may obtain information about an external image. Forexample, the wearable glasses 100 may capture a sky image 3411 andanalyze the sky image 3411. As there are fewer edges than a thresholdnumber in the sky image 3411 as a result of analysis, the wearableglasses 100 may display the news content 3401 as a video signal.

Referring to 3420 of FIG. 34, while a user wearing the wearable glasses100 is walking in a public place where there are many people, thewearable glasses 100 may receive a push message including the newscontent 3401 from the server 300. The wearable glasses 100 may obtaininformation about an external image. For example, the wearable glasses100 may capture a public place image 3421 and analyze the public placeimage 3421.

As a result of analysis, more edges than a threshold number are in thepublic place image 3421, and thus the wearable glasses 100 may displaythe news content 3401 as audio signal 3402.

According to an exemplary embodiment, if an external image viewedthrough the eyes of the user is complicated, it is difficult for theuser to visually identify notification content, and thus, the wearableglasses 100 may provide notification content as an audio signal insteadof a video signal.

FIG. 35 illustrates a flowchart of a method used by a wearable glassesto determine whether to output notification content based on variationinformation of an external image, according to an exemplary embodiment.

In operation S3510, the wearable glasses 100 may detect occurrence of anotification event.

In operation S3520, the wearable glasses 100 may obtain variationinformation about an external image when detecting occurrence of anotification event. The variation information about an external imagemay indicate information about a degree of change of an external imageobserved by the user.

According to an exemplary embodiment, the wearable glasses 100 mayobtain a plurality of external images by using the image sensor 161. Thewearable glasses 100 may calculate a variation in an external image bycomparing respective frames of a plurality of external images obtainedfor a period of time. For example, when the user wearing the wearableglasses 100 is moving, a variation in an external image calculated bythe wearable glasses 100 may be greater than a variation in an externalimage of when the user wearing the wearable glasses 100 is in astandstill state.

According to an exemplary embodiment, the wearable glasses 100 mayrequest analysis of an external image while transmitting the capturedexternal image to the mobile terminal 200 or the server 300. Thewearable glasses 100 may receive variation information of the externalimage from the mobile terminal 200 or the server 300.

In operation S3530, the wearable glasses 100 may determine whether thevariation of the external image is less than a threshold value.

For example, the wearable glasses 100 may determine whether a differencebetween a first frame obtained at an n-th second and a second frameobtained at (n+1)th second is less than a threshold value (e.g., 30%).

When the variation of the external image is less than a threshold value(S3530, YES), the wearable glasses 100 may determine to outputnotification content in operation S3540. The wearable glasses 100 mayoutput notification content at a present time.

For example, when a movement speed of a user is less than a thresholdspeed or if a gaze of the user is not distractible, a variation of anexternal image may be less than a threshold value. In this case, evenwhen notification content is output, the user may be not in a danger,and thus, the wearable glasses 100 may determine to output notificationcontent.

On the other hand, when the variation of the external image is equal toor greater than a threshold value (S3530, NO), the wearable glasses 100may not output notification content, and may determine to display anindicator indicating occurrence of a notification event, in operationS3550.

For example, when the variation of the external image is equal to orgreater than a threshold value, the wearable glasses 100 may not displaynotification content or may display a simple indicator indicatingoccurrence of a notification event in order not to obstruct the user'sview. An operation of the wearable glasses 100 to determine whether tooutput notification content based on variation information of anexternal image will be described in detail with reference to FIG. 36.

FIG. 36 illustrates an example of changing, by a wearable glasses, anoutput form of content corresponding to a notification event based onvariation information of an external image.

Referring to 3600-1 of FIG. 36, while a user wearing the wearableglasses 100 is crossing a pedestrian crossing, the wearable glasses 100may receive a push message including news content from the server 300.In this case, the wearable glasses 100 may detect that a notificationevent for displaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain variation information of an external image before displaying thenews content, and determine whether the variation of the external imageis less than a threshold value. For example, as the user is crossing apedestrian crossing, the wearable glasses 100 may obtain variation imageof a surrounding image 3610 around the pedestrian crossing. In thiscase, as the variation of the surrounding image 3610 around thepedestrian crossing is equal to or greater than the threshold value, thewearable glasses 100 may determine not to output the news content at apresent time. The wearable glasses 100 may display a simple indicator3611 indicating occurrence of the notification event.

According to an exemplary embodiment, the wearable glasses 100 may notdisplay the news content while the user is passing the pedestriancrossing but display the indicator 3611 to thereby minimize obstructionof the view of the user.

Referring to 3600-2 of FIG. 36, while a user wearing the wearableglasses 100 is sitting and looking at the wall, the wearable glasses 100may receive a push message including news content 3621 from the server300. In this case, the wearable glasses 100 may detect that anotification event for displaying the news content 3621 has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain variation information of the external image before displaying thenews content 3621 and determine whether the variation of the externalimage is less than a threshold value. For example, as the user islooking at the wall at home, the wearable glasses 100 may obtainvariation information of a wall image 3610. In this case, the wearableglasses 100 may determine to output the news content 3621 at a presenttime as the variation of the wall image 3620 is less than the thresholdvalue.

The wearable glasses 100 may display the news content 3621 (for example,“Sochi Olympics, Silver medal for Yuna Kim! Figure skater Yuna Kim haswon a valuable silver medal at the Sochi Olympics!”) in the form of AR,MR, or VR. In this case, the user may check the news content 3621 viathe wearable glasses 100 in a situation that is not dangerous eventhough the view of the user is obstructed.

Hereinafter, an operation of the wearable glasses 100 to adjust atransparency, a color, and chroma of notification content will bedescribed in detail with reference to FIG. 37.

FIG. 37 illustrates a flowchart of a method used by a wearable glassesto adjust at least one of a transparency, a color, and a chroma ofcontent corresponding to a notification event based on external imageinformation, according to an exemplary embodiment.

In operation S3710, the wearable glasses 100 may detect occurrence of anotification event.

In operation S3720, the wearable glasses 100 may obtain informationabout an external image by using the image sensor 161. Information aboutan external image may include at least one of variation information ofthe external image, color information of the external image, and objectinformation about objects included in an external image, but is notlimited thereto.

Operations S3710 and S3720 respectively correspond to operations S3310and S3320 of FIG. 33, and thus detailed description thereof will beomitted.

In operation S3730, the wearable glasses 100 may determine whether tooutput notification content based on the information about an externalimage.

According to an exemplary embodiment, the wearable glasses 100 maydetermine not to output notification content when a number of edgesdetected from the external image is greater than or equal to a thresholdnumber. The threshold number may be preset. On the contrary, when anumber of edges detected from the external image is less than thethreshold number, the wearable glasses 100 may determine to outputnotification content.

According to an exemplary embodiment, when a variation of the externalimage is equal to or greater than a threshold value, the wearableglasses 100 may determine not to output notification content. On thecontrary, the wearable glasses 100 may determine to output notificationcontent when a variation of the external image is less than a thresholdvalue.

In operation S3740, the wearable glasses 100 may adjust at least one ofa transparency, a color, and a chroma of notification content when it isdetermined to output the notification content.

According to an exemplary embodiment, the wearable glasses 100 mayadjust at least one of a transparency, a color, and a chroma ofnotification content based on illuminance information. For example, thewearable glasses 100 may measure an illuminance value by using anilluminance sensor. When a measured illuminance value is less than athreshold value, the wearable glasses 100 may reduce a transparency ofnotification content and increase a chroma of the notification content.

According to an exemplary embodiment, the wearable glasses 100 mayadjust at least one of a transparency, a color, and a chroma ofnotification content based on acceleration information. For example, thewearable glasses 100 may increase a transparency of notification contentas a movement speed of a user increases.

According to an exemplary embodiment, the wearable glasses 100 mayadjust at least one of a transparency, a color, and a chroma ofnotification content based on color information of an external image.For example, the wearable glasses 100 may display notification contentin a color that is complementary to a color of the external image.

In operation S3750, the wearable glasses 100 may output notificationcontent based on at least one of the adjusted transparency, color, andchroma. This operation will be described below with reference to FIG.38.

FIG. 38 illustrates a diagram for describing an example of adjusting, bya wearable glasses, a color of content corresponding to a notificationevent based on external image information.

Referring to FIG. 38, while a user wearing the wearable glasses 100 islooking up to the sky, the wearable glasses 100 may detect occurrence ofa notification event. In this case, the wearable glasses 100 may obtaina sky image 3800.

The wearable glasses 100 may adjust a color of notification contentbased on color information of the sky image 3800. For example, when abasic color of the notification content is blue 3810, it may bedifficult for the user to identify the notification content displayed inblue 3810 and in an AR form on the sky image 3800.

Accordingly, the wearable glasses 100 may change the color of thenotification content from blue 3810 to yellow 3820 and display thenotification content in yellow 3820.

FIG. 39 illustrates a flowchart of a method used by a wearable glassesto determine an output position of content corresponding to anotification event, according to an exemplary embodiment.

In operation S3910, the wearable glasses 100 may detect occurrence of anotification event.

In operation S3920, the wearable glasses 100 may obtain informationabout an external image by using the image sensor 161. Information aboutan external image may include at least one of color information of theexternal image and object information about objects included in theexternal image, but is not limited thereto.

Operations S3910 and 3920 respectively correspond to operations S3310and S3320 of FIG. 33, and thus detailed description thereof will beomitted.

In operation S3930, the wearable glasses 100 may determine an outputposition of notification content based on at least one of objectinformation about objects included in the external image and colorinformation of the external image.

For example, the wearable glasses 100 may determine a position that doesnot overlap with an actual object (e.g., a conversation partner) as anoutput position of notification content, based on object informationabout objects included in the external image. Also, the wearable glasses100 may determine an area where a basic color of notification contentand a complementary thereof are displayed, as an output position ofnotification content.

In operation S3940, the wearable glasses 100 may output notificationcontent at the determined output position. This operation will bedescribed below with reference to FIG. 40.

FIG. 40 illustrates a diagram for describing an example of changing, bya wearable glasses, an output position of content corresponding to anotification event.

Referring to FIG. 40, while a first user who is wearing the wearableglasses 100 is having conversation with a second user, the wearableglasses 100 may receive a push message including news content 4000 fromthe server 300. In this case, the wearable glasses 100 may detect that anotification event for displaying the news content 4000 has occurred.

As shown in 4010 of FIG. 4, when the wearable glasses 100 displays thenews content 4000 in a center portion, the face of the second user maybe covered by the news content 4000.

Accordingly, the wearable glasses 100 may obtain information about anexternal image before displaying the news content 4000. For example, thewearable glasses 100 may obtain a capture image including the seconduser, by using the image sensor 161. The wearable glasses 100 mayanalyze the capture image to detect a position of the second user. Thewearable glasses 100 may determine an area that does not overlap withthe second user, as a display position of the news content 4000.

As shown in 4020 of FIG. 40, the wearable glasses 100 may display thenews content 4000 in an area that does not overlap with the face of thesecond user.

According to an exemplary embodiment, as the face of the second user isshifted, the wearable glasses 100 may adaptively change the displayposition of the news content 4000.

FIG. 41 illustrates a flowchart of a method used by a wearable glassesto determine a method of providing content corresponding to anotification event based on setting information of a user, according toan exemplary embodiment.

In operation S4110, the wearable glasses 100 may receive settinginformation related to providing of notification content. For example,the wearable glasses 100 may receive setting information about at leastone of a time to provide notification content, a place of providingnotification content, and a form of providing notification content.

According to an exemplary embodiment, the wearable glasses 100 mayreceive setting information related to providing of notification contentfrom the mobile terminal 200 or the server 300. For example, the usermay set whether to output notification content, a time to outputnotification content, an output form of notification content, and aplace of outputting notification content by using the mobile terminal200.

In operation S4120, the wearable glasses 100 may detect occurrence of anotification event.

In operation S4130, when detecting occurrence of notification event, thewearable glasses 100 may determine a method of providing notificationcontent based on setting information. For example, the wearable glasses100 may determine a time to provide notification content, a place ofproviding notification content, and a form of providing notificationcontent based on setting information.

In operation S4140, the wearable glasses 100 may provide notificationcontent. For example, the wearable glasses 100 may provide notificationcontent at a time and in a form according to setting information. Thetime and the form may be predetermined.

Hereinafter, an operation of the wearable glasses 100 to providenotification content based on setting information will be described indetail with reference to FIGS. 42 through 44.

FIG. 42 illustrates an example of setting information 4200 related tooutput of content corresponding to a notification event.

As illustrated in FIG. 42, a user may select whether to outputnotification content according to a position 4201 or an application4202.

For example, when a user is in a library, the user may set to blockoutput of notification content; when the user is at home, the user mayset to output the entire notification content output; and when the useris in an office, the user may set to output a portion of notificationcontent.

Also, the user may set to output a portion of notification contentcorresponding to a first application and block output of notificationcontent corresponding to a second application.

According to an exemplary embodiment, the wearable glasses 100 mayobtain the setting information 4200 related to output of notificationcontent from the mobile terminal 200 or the server 300 and store thesetting information 4200 in a memory.

Also, when a notification event has occurred, the wearable glasses 100may output notification content based on setting information. This willbe described below with reference to FIGS. 43 and 44.

FIGS. 43 and 44 illustrate an example of outputting, by a wearableglasses, content corresponding to a notification event based on settinginformation of a user.

Referring to FIG. 43, while a user wearing the wearable glasses 100 isstaying at home, the wearable glasses 100 may receive a push messageincluding news content from the server 300. In this case, the wearableglasses 100 may detect that a notification event for displaying newscontent has occurred.

The wearable glasses 100 may check setting information 4200 related tooutput of a notification event before outputting the notification event.As the setting information 4200 is set to output the entire notificationcontent when the user wearing the wearable glasses 100 is at home, thewearable glasses 100 may output the entire news content 4300.

Referring to FIG. 44, while the user wearing the wearable glasses 100 isin an office, the wearable glasses 100 may receive a push messageincluding news content via the mobile terminal 200. In this case, thewearable glasses 100 may detect that a notification event for displayingnews content has occurred.

The wearable glasses 100 may check the setting information 4200 relatedto output of a notification event before outputting the notificationevent. As the setting information 4200 is set to output a portion ofnotification content when the user wearing the wearable glasses 100 isin an office, the wearable glasses 100 may output a portion of newscontent 4400 (e.g., a headline).

FIG. 45 illustrates a flowchart of a method used by a wearable glassesto receive emergency notification information from an external wearabledevice 400, according to an exemplary embodiment.

In operation S4510, the external wearable device 400 may measurebiometric information of a user.

The external wearable device 400 may include, for example, a ring, anecklace, a band, a watch, shoes, an ear ring, a hair band, clothes,gloves, or a thimble, but is not limited thereto.

According to an exemplary embodiment, the external wearable device 400may measure pulse rate information, blood pressure information, heartrate information, body temperature information or the like.

In operation S4520, the external wearable device 400 may determine anemergency based on the biometric information.

For example, the external wearable device 400 may determine that anemergency occurred when a pulse rate of the user is equal to or greaterthan a threshold rate (e.g., 100 times per minute) for a period of timeor when a body temperature of a user is equal to a threshold temperatureor higher (e.g., 38° C.).

In operation S4530, when it is determined that an emergency occurred,the external wearable device 400 may transmit emergency notificationinformation to the wearable glasses 100. Emergency notificationinformation may include biometric information measured by the externalwearable device 400, a message notifying the user of the emergency, anicon indicating the emergency, and the like.

According to an exemplary embodiment, the external wearable device 400may transmit emergency notification information to the wearable glasses100 via short-range communication (e.g., Bluetooth, WFD, NFC, etc.).

According to an exemplary embodiment, the external wearable device 400may transmit emergency notification information to the wearable glasses100 via the mobile terminal 200 or the server 300.

In operation S4530, the wearable glasses 100 may detect occurrence of anotification event. For example, the wearable glasses 100 may detectthat a notification event for outputting an emergency notificationmessage has occurred.

In operation S4550, the wearable glasses 100 may provide notificationcontent.

According to an exemplary embodiment, since it is an emergency, thewearable glasses 100 may promptly provide an emergency notificationmessage regardless of movement information of the user or external imageinformation. An operation of the wearable glasses 100 to output anemergency notification message will be described in detail withreference to FIG. 46.

FIG. 46 illustrates an example of displaying, by a wearable glasses,pulse rate information received from an external wearable device.

Referring to 4610 of FIG. 46, a smart watch 400-1 may measure a pulserate of a user. The smart watch 400-1 measures a pulse rate of a user atcertain periods of time. The smart watch 400-1 may measure a pulse rateof a user when a certain event has occurred. A certain event may includean event for setting an exercise mode by a user and an event forselecting a button for requesting to measure a pulse rate, and the like,but is not limited thereto.

For example, a pulse rate of a user measured by the smart watch 400-1may be 97 beats per minute (BPM). A normal pulse rate of the user may be81 BPM.

Referring to 4620 of FIG. 46, the smart watch 400-1 may compare themeasured pulse rate (97 BPM) and the typical normal pulse rate of theuser (81 BPM). As a difference between the measured pulse rate (97 BPM)and the normal pulse rate of the user (81 BPM) exceeds a threshold value(e.g., 10 BPM), the smart watch 400-1 may determine that the pulse rateof the user is abnormal.

In this case, the smart watch 400-1 may output a notification message‘abnormal pulse rate.’ Also, the smart watch 400-1 may transmit to thewearable glasses 100 emergency notification information notifying theuser that pulse rate is abnormal.

Referring to 4630 of FIG. 46, the wearable glasses 100 may receiveemergency information directly from the smart watch 400-1 or via themobile terminal 200.

The wearable glasses 100 may output emergency notification content(e.g., “Emergency! Pulse rate decreased.”) based on the receivedemergency notification information.

According to an exemplary embodiment, the user may check biometricinformation measured using the external wearable device 400 andemergency notification content in real time by using the wearableglasses 100.

FIG. 47 illustrates a flowchart of a method used by a wearable glassesto output content corresponding to a notification event via an externaldevice, according to an exemplary embodiment.

In operation S4710, the wearable glasses 100 may detect occurrence of anotification event.

In operation S4720, when detecting occurrence of a notification event,the wearable glasses 100 may obtain movement information of a user.Movement information of a user may include at least one of movementstate information, movement speed information, and position informationof the user, but is not limited thereto.

In operation S4730, the wearable glasses 100 may determine a method ofproviding notification content. According to an exemplary embodiment,the wearable glasses 100 may determine a time to provide notificationcontent. Also, according to an exemplary embodiment, the wearableglasses 100 may determine a form of providing notification content.

Operations S4710 through S4730 respectively correspond to operationsS510 through S530 of FIG. 5, and thus detailed description thereof willbe omitted.

In operation S4740, the wearable glasses 100 may output notificationcontent. According to an exemplary embodiment, the wearable glasses 100may output notification content according to a method of providingnotification content. For example, the wearable glasses 100 may output aportion of notification content.

In operation S4750, the wearable glasses 100 may receive a user inputfor requesting to transmit notification content to an external device4700. User inputs may vary. For example, a user input may be at leastone of a motion input, a touch input, a key input, a voice input, and amultiple input, but is not limited thereto.

According to an exemplary embodiment, the external device 4700 may beother wearable device different from the wearable glasses 100. Forexample, the external device 4700 may be a smart watch, a band, or anecklace. Also, the external device 4700 may be the mobile terminal 200connected to the wearable glasses 100.

According to an exemplary embodiment, the wearable glasses 100 mayreceive an input for selecting the external device 4700 to transmitnotification content. For example, the wearable glasses 100 may receivean input for selecting a smart watch or an input for requestingtransmission of notification content to the smart watch.

According to an exemplary embodiment, the external device 4700 used totransmit notification content may be preset.

Also, according to an exemplary embodiment, the wearable glasses 100 maysearch for a wearable device located within a short-range communicationradius and transmit notification content to the found wearable device.

In operation S4760, the wearable glasses 100 may transmit notificationcontent to the external device 4700 according to a user input. Forexample, the wearable glasses 100 may transmit notification content tothe external device 4700 via short-range communication (e.g., Bluetooth)or mobile communication (e.g., 3G/4G/5G).

According to an exemplary embodiment, the wearable glasses 100 maydirectly transmit notification content to the external device 4700 ortransmit notification content to the external device 4700 via the mobileterminal 200.

For example, when the external device 4700 is a wearable device, thewearable glasses 100 may transmit notification content to the externaldevice 4700 via the mobile terminal 200 connecting the wearable deviceand the wearable glasses 100.

In operation S4770, the external device 4700 may output notificationcontent. For example, the external device 4700 may display notificationcontent on a screen. When the notification content is a video, theexternal device 4700 may replay the notification content. An operationof the external device 4700 that is connected to the wearable glasses100 and outputs notification content will be described in detail withreference to FIG. 48.

FIG. 48 illustrates an example of outputting, by a wearable glasses,content corresponding to a notification event based on a user input.

Referring to 4800-1 of FIG. 48, while a user wearing the wearableglasses 100 is crossing a pedestrian crossing, the wearable glasses 100may receive a push message including news content from the server 300.In this case, the wearable glasses 100 may detect that a notificationevent for displaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the newscontent. For example, the wearable glasses 100 may determine that theuser is moving at a speed of 3 km/h.

As the user is moving, the wearable glasses 100 may output a portion4810 of the news content in order not to obstruct the user's view much.For example, the wearable glasses 100 may extract a headline from thenews content and output the extracted headline.

Referring to 4800-2 of FIG. 48, the user may perform a shaking gesture4820 of shaking the hand before the wearable glasses 100 in order tocheck entire content 4830 of the news content on a smart watch 4800after checking the headline of the news content.

In this case, the wearable glasses 100 may sense the shaking gesture4820 of the user while outputting the portion 4810 of news content(e.g., a headline). For example, the wearable glasses 100 may sense theshaking gesture 4820 of the user shaking the hand by using, for example,the depth sensor 154 or the image sensor 161.

The wearable glasses 100 may transmit the news content according to theshaking gesture 4820 of the user. According to an exemplary embodiment,the wearable glasses 100 may transmit the news content directly to thesmart watch 4800 or transmit the news content to the smart watch 4800via the mobile terminal 200.

According to an exemplary embodiment, the smart watch 4800 may displaythe entire content 4830 of the news content received from the wearableglasses 100 on a screen. The wearable glasses 100 may now not output theportion 4810 of news content anymore.

According to another exemplary embodiment, in order to prevent that newscontent is transmitted from the wearable glasses 100 to the smart watch4800 regardless of the user's intention, the wearable glasses 100 maytransmit the news content to the smart watch 4800 only when a timeperiod of the shaking gesture 4820 is equal to or greater than athreshold period or when the number of times of shaking is a thresholdnumber of times or more (e.g., twice). That is, in order to prevent theinadvertent transmission of the news content to the smart watch 4800when, for example, the user scratches an itch, the wearable glasses 100may check to ensure that the shaking gesture 4820 is an intended motionfor transmitting the news content.

Meanwhile, while the shaking gesture 4820 is described as an example ofuser input for transmitting notification content in FIG. 48, the userinput is not limited thereto. For example, the user may input voice forrequesting to transmit notification content to the wearable glasses 100or press a button included in the wearable glasses 100.

FIG. 49 illustrates a flowchart of a method used by a wearable glassesto transmit content corresponding to a notification event in response toa request by an external device, according to an exemplary embodiment.

In operation S4910, the wearable glasses 100 may detect occurrence of anotification event.

In operation S4920, the wearable glasses 100 may obtain movementinformation of a user.

In operation S4930, the wearable glasses 100 may output notificationcontent according to a method of providing notification contentdetermined based on the movement information of the user.

Operations S4910 through S4930 respectively correspond to operationsS4710 through S4730 of FIG. 47, and thus detailed description thereofwill be omitted.

In operation S4940, the external device 4900 may receive a user inputfor requesting to output notification content from the external device4900.

According to an exemplary embodiment, the external device 4900 may beanother wearable device different from the wearable glasses 100. Forexample, the external device 4900 may be a smart watch, a band, or anecklace. Also, the external device 4900 may be the mobile terminal 200connected to the wearable glasses 100.

According to an exemplary embodiment, user inputs requesting to outputnotification content may vary. For example, a user input may be at leastone of a motion input, a touch input, a key input, a voice input, and amultiple input, but is not limited thereto.

In operation S4950, the external device 4900 may request the wearableglasses 100 to transmit notification content. The external device 4900may request the wearable glasses 100 to directly transmit notificationcontent or request the wearable glasses 100 to transmit notificationcontent via the mobile terminal 200.

In operation S4960, the wearable glasses 100 may transmit thenotification content to the external device 4900. For example, thewearable glasses 100 may transmit the notification content to theexternal device 4900 via short-range communication (e.g., Bluetooth) ormobile communication (e.g., 3G/4G/5G).

According to an exemplary embodiment, the wearable glasses 100 maydirectly transmit notification content to the external device 4900 ormay transmit notification content to the external device 4900 via themobile terminal 200. For example, when the external device 4900 is awearable device, the wearable glasses 100 may transmit notificationcontent to the external device 4900 via the mobile terminal 200connecting a wearable device and the wearable glasses 100.

In operation S4970, the external device 4900 may output notificationcontent. For example, the external device 4900 may display notificationcontent on a screen. When notification content is a video, the externaldevice 4900 may replay the notification content. An operation of theexternal device 4900 that is connected to the wearable glasses 100 andoutputs notification content will be described in detail with referenceto FIG. 50.

FIG. 50 illustrates an example of displaying, by an external device,content corresponding to a notification event based on a user inputreceived via the external device, wherein the external device isconnected to a Wearable glasses, according to an exemplary embodiment.

Referring to 5000-1 of FIG. 50, while a user wearing the Wearableglasses 100 is crossing a pedestrian crossing, the Wearable glasses 100may receive a push message including news content from the server 300.In this case, the wearable glasses 100 may detect that a notificationevent for displaying news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user before displaying the newscontent. For example, the wearable glasses 100 may determine that theuser is moving at a speed of 3 km/h.

As the user is moving, the wearable glasses 100 may output a portion5010 of news content in order not to obstruct the user's view much. Forexample, the wearable glasses 100 may extract a headline from the newscontent and output the extracted headline.

Referring to 5000-2 of FIG. 50, the user may select a button of thesmart watch 5000 to check the entire content 5030 of the news content onthe smart watch 5000 after checking the headline of the news content.The button may be predetermined or pre-assigned. The button maycorrespond to a command directing to display notification contentdisplayed via the wearable glasses 100 on the smart watch 5000.According to an exemplary embodiment, the button may be a physicalbutton or a virtual button in the form of a graphical user interface(GUI).

The smart watch 5000 may request the wearable glasses 100 to transmitthe news content being displayed by the wearable glasses 100.

The wearable glasses 100 may transmit the news content to the smartwatch 5000 in response to a request by the smart watch 5000. Accordingto an exemplary embodiment, the wearable glasses 100 may transmit thenews content directly to the smart watch 5000 or may transmit the newscontent to the smart watch 5000 via the mobile terminal 200.

Referring to 5000-3 of FIG. 50, the smart watch 5000 may display theentire content 5030 of the news content received from the wearableglasses 100 on a screen. The wearable glasses 100 may not output theportion 5010 of the news content anymore.

FIG. 51 illustrates a flowchart of a method used by a wearable glassesto output content corresponding to a notification event based onmovement information of a user, according to an exemplary embodiment.

In operation S5110, the wearable glasses 100 may establish acommunication link with an external device 5100.

For example, the wearable glasses 100 may establish a short-rangecommunication or a mobile communication link (e.g., 3G, 4G or 5G) withthe external device 5100. Examples of the short-range communication mayinclude Bluetooth, BLE, WFD, UWB, Zigbee, NFC, and Ant+, but are notlimited thereto.

In operation S5120, the wearable glasses 100 may detect occurrence of anotification event.

In operation S5130, when detecting occurrence of the notification event,the wearable glasses 100 may obtain movement information of a user.

According to an exemplary embodiment, the wearable glasses 100 mayobtain movement information of the user by using at least one of anacceleration sensor, a tilt sensor, and a position sensor. According toan exemplary embodiment, the wearable glasses 100 may also obtainmovement information of the user by using schedule information or lifepattern information of the user. According to an exemplary embodiment,the wearable glasses 100 may analyze movement information of the user byusing biometric information measured by using an external wearabledevice.

In operation S5140, the wearable glasses 100 may determine to outputnotification content via an external device 5100 based on the movementinformation of the user.

For example, the wearable glasses 100 may determine whether a movementspeed of the user is less than a threshold speed (e.g., 4 km/h) based onthe movement information of the user. When the movement speed of theuser is equal to or greater than a threshold speed, the wearable glasses100 may determine to output notification content via the external device5100, and if the movement speed of the user is less than the thresholdspeed, the wearable glasses 100 may determine to output notificationcontent immediately from the wearable glasses 100.

In operation S5150, when it is determined to output notification contentvia the external device 5100, the wearable glasses 100 may transmitnotification content to the external device 5100. According to anexemplary embodiment, the wearable glasses 100 may transmit notificationcontent to the external device 5100 via a previously establishedcommunication link.

In operation S5160, the external device 5100 may output contentcorresponding to a notification event. For example, the external device5100 may display notification content on a screen. When notificationcontent is a video, the external device 5100 may replay the notificationcontent.

In operation S5170, when it is determined not to output notificationcontent via the external device 5100, the wearable glasses 100 mayoutput the notification content.

FIG. 52 illustrates an example of outputting, by a wearable glasses,content corresponding to a notification event based on movementinformation of a user.

Referring to 5200-1 of FIG. 52, while a user wearing the wearableglasses 100 is walking in a public space where there are many people,the wearable glasses 100 may receive a push message including newscontent 5210 from the server 300. In this case, the wearable glasses 100may detect that a notification event for displaying the news content5210 has occurred.

The wearable glasses 100 may obtain movement information of the userbefore displaying the news content 5210 and determine whether a movementspeed of the user is less than a threshold speed (e.g., 2 km/h). Forexample, a movement speed of the user who is walking in a public spacemay be 3 km/h. In this case, as the movement speed of the user (e.g., 3km/h) is equal to or greater than the threshold speed (2 km/h), thewearable glasses 100 may determine to output the news content 5210 notfrom the wearable glasses 100 but via the smart watch 5200.

Referring to 5200-2 of FIG. 52, the wearable glasses 100 may request tooutput the news content 5210 while transmitting the news content 5210 tothe smart watch 5200. The smart watch 5200 may display the news content5210 on a screen according to the request by the wearable glasses 100.

According to an exemplary embodiment, when the user wearing the wearableglasses 100 is moving at a threshold speed or greater, the wearableglasses 100 may output notification content to another wearable device(e.g., the smart watch 5200) in order not to obstruct the user's view.

FIG. 53 illustrates a flowchart of a method used by a wearable glassesto provide a list of non-output contents, according to an exemplaryembodiment.

In operation S5310, the wearable glasses 100 may receive a user inputfor requesting a list of non-output contents. The list of non-outputcontents may include notification content that is not output when anotification event has occurred and notification content including aportion which is output when a notification event has occurred.

According to an exemplary embodiment, a user input for requesting a listof non-output contents may vary. For example, a user input forrequesting a list of non-output contents may include an input fortouching a certain area of a frame of glasses, an input for selecting abutton included in a frame of glasses, a voice sound input forrequesting a list of non-output contents, a head up motion input forlifting the head, or the like, but is not limited thereto. The certainarea of the frame of the glasses may be predetermined.

In operation S5320, the wearable glasses 100 may provide a list ofnon-output contents in response to a user input. For example, thewearable glasses 100 may display a list of non-output contents in an ARform.

According to an exemplary embodiment, when it is not possible to displaynon-output contents on a single screen, the wearable glasses 100 mayreceive a scroll request from a user. The wearable glasses 100 mayscroll non-output contents vertically or horizontally in response to thescroll request of the user.

Throughout the specification, “scrolling” refers to an operation of thewearable glasses 100 to vertically or horizontally move informationdisplayed on a screen when an amount of information to be displayed onthe screen is greater than a displayable amount of information to bedisplayed on the screen of the wearable glasses 100 so that newinformation corresponding to an amount of information that disappearedfrom the moved screen appears from an opposite direction.

In operation S5330, the wearable glasses 100 may receive an input forselecting one piece of content included in the list. For example, when ashaking motion input for shaking the head vertically is sensed, thewearable glasses 100 may recognize the same as an input for the user toselect content displayed in a center of the list.

Also, the wearable glasses 100 may receive an eyeball input forselecting one piece of content included in the list. For example, thewearable glasses 100 may select a content in the list based on aneyeball input of blinking the eyes a threshold number of times or moreor gazing at content for a threshold period of time or longer.

In operation S53540, the wearable glasses 100 may output selectedcontent. For example, the wearable glasses 100 may display or replaynon-output notification content on a screen.

According to an exemplary embodiment, the wearable glasses 100 mayprovide a list of non-output contents so that the user may select andcheck from the list notification content wished to be checked.

Meanwhile, according to an exemplary embodiment, the wearable glasses100 may provide a list of output notification contents. The user mayselect notification content from the list of output notificationcontents and check notification content again.

FIG. 54 illustrates an example of providing, by a wearable glasses, alist of non-output contents based on a certain user input. In regard toFIG. 54, a user input for requesting to provide a list 5411 ofnon-output contents is a head up motion 5410, and a user input forrequesting scrolling is a shaking motion 5420.

Referring to 5400-1 of FIG. 54, while occurrence of a notification eventis not sensed, the wearable glasses 100 may receive the head up motion5410 of a user lifting the head. For example, the wearable glasses 100may sense the head up motion 5410 of the user by using, for example, atilt sensor, an acceleration sensor, or a gyroscope sensor.

The wearable glasses 100 may display a list 5411 of non-output contentsin response to the head up motion 5410 of the user.

According to another exemplary embodiment, in order to prevent that thelist 5411 of non-output contents is displayed regardless of the user'sintention, the Wearable glasses 100 may display the list 5411 ofnon-output contents only when a time period of the head up motion 5410is equal to or greater than a threshold time (e.g., two seconds). Thatis, in order to prevent the inadvertent display of the list 5411 when,for example, the user looks up at a plane or bird in the sky, thewearable glasses 100 may check to ensure that the head up motion 5410 isan intended motion for displaying the list.

Referring to 5400-2 of FIG. 54, the wearable glasses 100 may sense theshaking motion 5420 of a user shaking the head to the left and the rightwhile the list 5411 of non-output contents is displayed.

For example, the wearable glasses 100 may sense the shaking motion 5420of shaking the head to the left and the right a threshold number oftimes (e.g., twice) or more by using, for example, a tilt sensor, anacceleration sensor or a gyroscope sensor. The wearable glasses 100 mayscroll the list 5411 of non-output contents according to the shakingmotion 5420 of the user.

According to an exemplary embodiment, when the user selects firstcontent 5422 from the list 5411 of non-output contents, the wearableglasses 100 may display or replay the first content 5422.

FIG. 55 illustrates an example of providing, by a wearable deviceconnected to a wearable glasses, a list of contents that are not yetoutput from the wearable glasses.

Referring to 5510 of FIG. 55, a smart watch 5500 connected to thewearable glasses 100 may display a list of contents that are not yetoutput from the wearable glasses 100. A user may check the list ofnon-output contents, and select first content 5501 from the list ofnon-output contents.

Referring to 5520 of FIG. 55, the smart watch 5500 may provide aselection window for selecting a device to display the first content5501.

When the user selects a direct view 5502 from the selection window 5502,the smart watch 5500 may display the first content 5501 that is not yetoutput from the wearable glasses 100 on a screen of the smart watch5500.

When the user selects a wearable glasses view 5503 from the selectionwindow, the smart watch 5500 may request the wearable glasses 100 tooutput the first content 5501. The wearable glasses 100 may display thefirst content 5501 according to a request by the smart watch 5500.

FIG. 56 illustrates an example of providing, by a wearable deviceconnected to a wearable glasses, a list of contents that have beenpreviously output from the wearable glasses.

Referring to 5610 of FIG. 56, a smart watch 5600 connected to thewearable glasses 100 may display a list of contents that have beenpreviously output from the wearable glasses 100. The user may check thelist of previously output contents and select an eleventh content 5601from the list of previously output contents.

Referring to 5620 of FIG. 56, the smart watch 5600 may provide aselection window from which a device to display the eleventh content5601 may be selected.

When the user selects a direct view 5602 from the selection window, thesmart watch 5600 may display the eleventh content 5601 that has beenpreviously output from the wearable glasses 100 on a screen of the smartwatch 5600.

When the user selects a wearable glasses view 5603 on the selectionwindow, the smart watch 5500 may request the wearable glasses 100 tooutput the eleventh content 5601. The wearable glasses 100 may displaythe eleventh content 5601 according to a request by the smart watch5600.

FIGS. 57 and 58 are block diagrams illustrating a structure of awearable glasses according to an exemplary embodiment.

As illustrated in FIG. 57, the wearable glasses 100 according to anexemplary embodiment may include an output device 110 and a controller120. However, not all of illustrated elements are necessary elements.The wearable glasses 100 may be implemented by more elements or lesselements than the illustrated elements.

For example, as illustrated in FIG. 58, the wearable glasses 100according to an exemplary embodiment may further include a user inputdevice 130, a communication interface 140, a sensing circuit 150, anaudio/video (A/V) input circuit, and a memory 170 in addition to theoutput module 110 and the controller 120. The sensing circuit 150 mayalso be referred to as a sensor circuit.

Hereinafter, the above-described elements will be described in detail.

The output device 110 is used to output an audio signal, a video signal,or a vibration signal, and may include the display 111, a sound outputdevice 112, and a vibration motor 113.

The display 111 may display information processed by the wearableglasses 100. For example, the display 111 may display contentcorresponding to a notification event (notification messageinformation). The display 111 may display content corresponding to anotification event in the form of AR, MR, or VR. Also, the display 111may display an indicator indicating occurrence of a notification event.

The display 111 may display a list of non-output contents. The list ofnon-output contents may include notification content that is not outputwhen a notification event has occurred and notification contentincluding a portion which is output when a notification event hasoccurred.

Meanwhile, when the display 111 is configured as a touch screen byforming a layer structure with a touch pad, the display 111 may also beused as a user input device as well as an output device. The display 111may include at least one of a liquid crystal display (LCD), a thin-filmtransistor-liquid crystal display (TFT-LCD), an organic light-emittingdiode (OLED), a flexible display, a 3D display, and an electrophoreticdisplay. According to an exemplary embodiment of the wearable glasses100, the wearable glasses 100 may include at least two displays 111.

The sound output circuit 112 outputs audio data received from thecommunication unit 140 or stored in the memory 170. Also, the soundoutput device 112 outputs a sound signal related to a function performedby the wearable glasses 100, such as a call signal reception sound, amessage reception sound, or a notification sound. The sound outputdevice 112 may include a speaker or a buzzer.

The vibration motor 113 may output a vibration signal. For example, thevibration motor 113 may output a vibration signal corresponding to anoutput of audio data or video data, for example, a call signal receptionsound or a message reception sound. Also, the vibration motor 113 mayoutput a vibration signal when a touch screen is touched.

The output device 110 may provide content corresponding to anotification event according to a method determined based on movementinformation of a user.

The controller 120 generally controls an overall operation of thewearable glasses 100. For example, the controller 120 may generallycontrol the output device 110, the user input device 130, thecommunication interface 140, the sensing circuit 150, and the A/V inputcircuit 160 by executing programs stored in the memory 170.

When detecting occurrence of a notification event, the controller 120may obtain movement information of a user wearing the wearable glasses100. The movement information of the user may include at least one ofmovement state information, movement speed information, and positioninformation of the user.

The controller 120 may determine whether the user is wearing thewearable glasses 100 based on at least one sensor included in thewearable glasses 100, and when it is determined that the user is wearingan wearable glasses, the controller 120 may obtain movement informationof the user.

The controller 120 may also obtain movement information of the user byanalyzing a movement of the user based on at least one of accelerationinformation, tilt information, and position information measured usingthe wearable glasses 100.

The controller 120 may determine a time to provide content correspondingto a notification event based on movement information of the user.

The controller 120 may determine to output notification content at apresent time when a movement speed of a user is less than a thresholdspeed and to output notification content at a different time when amovement speed of the user is equal to or greater than a thresholdspeed. The different time may include at least one of a point of time ofreceiving a user input for requesting to output content corresponding toa notification event, a point of time when a movement of the user ischanged, and a point of time when the preset time has passed, but is notlimited thereto.

The controller 120 may determine a method of providing contentcorresponding to a notification event based on movement information ofthe user. For example, the controller 120 may determine to output aportion of notification content when a movement speed of the user isequal to or greater than a threshold speed, and if the movement speed ofthe user is less than the threshold speed, the controller 120 maydetermine to output the entire notification content.

The controller 120 may determine to output notification content as atleast one of an audio signal or a video signal in consideration ofenvironment information about an environment within a certain distancefrom the wearable glasses 100. The environment information may includeat least one of external sound information about sounds generated withina certain distance from the wearable glasses 100 and information aboutan external image obtained by using the image sensor 161.

The controller 120 may control the display 111 to display receivednotification message information based on a signal output from thesensing circuit 150.

The controller 120 may determine whether a user is wearing wearableglasses based on a signal output from at least one sensor included inthe sensing circuit 150, and when it is determined that the user iswearing wearable glasses, the controller 120 may control the sensingcircuit 150 to sense a movement of the user.

The user input device 130 is used by a user to input data used tocontrol the wearable glasses 100. Examples of the user input unit 130include a keypad, a dome switch, a touch pad (a touch capacitance type,a pressure resistance film type, an infrared light detecting type, asurface ultrasound conducting type, an integral tension measuring type,or a piezo-effect type), a jog wheel, and a jog switch, but are notlimited thereto.

The user input device 130 is described above with reference to FIG. 2,and thus repeated description will be omitted.

The user input device 130 may receive a user input for requesting tooutput notification content.

The user input device 130 may receive a first user input for requestingto output the entire content. For example, the first user input may beat least one of a motion input, a touch input, a key input, a voiceinput, and a multiple input, but is not limited thereto. According to anexemplary embodiment, a first user input for requesting to output theentire notification content may be preset. For example, the user may seta head up motion of lifting the head as a first user input forrequesting to output the entire notification content.

The user input device 130 may receive a second user input for requestingto block output of a portion of notification content. The second userinput may also be various.

The user input device 130 may receive a user input for requesting a listof non-output contents. A user input for requesting a list of non-outputcontents may include an input for touching a certain area of a frame ofglasses, an input for selecting a button included in a frame of glasses,an input for requesting a list of non-output contents, a head up motioninput for lifting the head, or the like, but is not limited thereto.

The user input device 130 may receive a user input for requesting totransmit notification content to an external device. The user inputdevice 130 may receive an input for selecting an external device totransmit notification content. For example, the user input device 130may receive an input for selecting a smart watch and an input forrequesting to transmit notification content to the smart watch.

The communication interface 140 may include at least one componentenabling the wearable glasses 100 to communicate with an external deviceor a server. For example, the communication interface 140 may include ashort-range wireless communication interface 141, a mobile communicationinterface 142, and a broadcast receiving circuit 143.

The short-range wireless communication interface 141 may include aBluetooth communication interface, a BLE communication interface, an NFCinterface, a wireless local area network (WLAN) (Wi-Fi) communicationinterface, a Zigbee communication interface, an infrared dataassociation (IrDA) communication interface, a WFD communicationinterface, an UWB communication interface, and an Ant+ communicationinterface, but components included in the short-range wirelesscommunication interface 141 are not limited thereto.

The mobile communication interface 142 transmits and receives a wirelesssignal to and from at least one of a base station, an external terminal,and a server, on a mobile communication network. Here, a wireless signalmay include data having various formats according to transmission andreception of a voice call signal, a video telephone call signal, or atext/multimedia message.

The broadcast receiving circuit 143 receives a broadcast signal and/orbroadcast related information from an external source, through abroadcast channel. The broadcast channel may include a satellite channelor a terrestrial broadcasting channel. In some embodiments, the wearableglasses 100 may not include the broadcast receiving circuit 143.

The communication interface 140 may receive notification messageinformation.

The communication interface 140 may request movement information of auser and receive from an external device connected to the wearableglasses 100. The communication interface 140 may request movementinformation of the user while transmitting acceleration information,tilt information, position information or the like measured using thewearable glasses 100 to the external device.

The communication interface 140 may request analysis of a capturedexternal image while transmitting the captured external image to themobile terminal 200 or the server 300. The communication interface 140may receive at least one of variation information of an external image,color information of an external image, and object information aboutobjects included in an external image, from the mobile terminal 200 orthe server 300.

The sensing circuit 150 may sense a state of the wearable glasses 100, astate of surroundings of the wearable glasses 100, a state of a userwearing the wearable glasses 100, movement of a user, and may transmitsensed information to the controller 120. For example, the sensingcircuit 150 may sense movement of the user and output a signal relatedto movement of the user to the controller 120. The signal may be anelectrical signal.

The sensing circuit 150 may include at least one of a magnetic sensor151, an acceleration sensor 152, a tilt sensor 153, a depth sensor 154,a gyroscope sensor 155, a position sensor 156 such as a globalpositioning system (GPS), an atmospheric pressure sensor 157, aproximity sensor 158, and an optical sensor 159, but a componentincluded in the sensing circuit 150 is not limited thereto. The sensingcircuit 150 may also include a temperature sensor, an illuminancesensor, a pressure sensor, or an iris scan sensor. Because functions ofeach sensor may be intuitively inferred by one of ordinary skill in theart based on its name, details thereof are not described herein.

The A/V input circuit 160 is used to receive an audio signal or a videosignal, and may include a camera (image sensor) 161 and a microphone162. The camera (image sensor) 161 may obtain an image frame of a stillimage or a video in a video telephone mode or a photographing mode. Animage captured via the camera (image sensor) 161 may be processed by thecontroller 120 or a separate image processor (not shown).

An image frame processed by the camera (image sensor) 161 may be storedin the memory 170 or transmitted to an external device through thecommunication interface 140. According to an exemplary embodiment of thewearable glasses 100, the wearable glasses 100 may include at least twocameras (image sensors) 161.

The microphone 162 receives an external sound signal and processes theexternal sound signal to electric voice data. For example, themicrophone 162 may receive a sound signal from an external device or anarrator. The microphone 162 may use any one of various noise removingalgorithms to remove noise generated while receiving the external soundsignal.

The memory 170 may store a program for processes and control of thecontroller 120, and may store input/output data such as a list ofnon-output contents, a list of previously output contents, capturedimages, biometric information, schedule information of a user, or lifepattern information of a user.

The memory 170 may include at least storage medium from among a flashmemory, a hard disk, a multimedia card micro type memory, a card typememory (for example, a secure digital (SD) card or an extreme digital(XD) card), a random access memory (RAM), a static random access memory(SRAM), a read-only memory (ROM), an electrically erasable programmableread-only memory (EEPROM), a programmable read-only memory (PROM), amagnetic memory, a magnetic disk, and an optical disk. Also, thewearable glasses 100 may operate a web storage server or a cloud serverthat performs a storage function of the memory 170 in the Internet.

Programs stored in the memory 170 may be classified into a plurality ofmodules based on functions, and for example, into a UI module 171, anotification module 172, a STT module 173, and an image processingmodule 174.

The UI module 171 may provide a specialized UI or GUI linked with thewearable glasses 100 according to applications. The notification module172 may generate a signal for notifying occurrence of an event in thewearable glasses 100. The notification module 172 may output anotification signal in the form of a video signal via the display 111 orin the form of an audio signal via the sound output device 112 or in theform of a vibration signal via the vibration motor 113.

The STT module 173 may convert voice included in multimedia content totext, thereby generating a transcript corresponding to the multimediacontent.

The image processing module 174 may obtain object information aboutobjects included in a captured image, edge information, atmosphereinformation, and color information by analyzing the captured image.

The methods described above may be implemented as program commands thatcan be executed using various computer components and may be recorded ona computer readable recording medium. The computer readable recordingmedium may include a program command, a data file, a data structure,etc., alone or in combination. The program commands recorded in thecomputer readable recording medium may be specially designed or wellknown to one of ordinary skill in the computer software field. Examplesof the computer readable recording medium include magnetic storage media(e.g., hard disks, floppy disks, magnetic media such as magnetic tapes,etc.), optical recording media (e.g., CD-ROMs or DVDs), magneto-opticalmedia (e.g., floptical disks), and hardware devices specificallyconfigured to store and execute program commands (e.g., ROM, RAM, flashmemories, etc.). Examples of the program command include mechanicalcodes prepared by a compiler, and high-level languages executable by acomputer by using an interpreter.

As described above, according to the one or more of the above exemplaryembodiments, the wearable glasses 100 may determine a time to providenotification content and a form of providing notification content basedon movement information of the user, thereby preventing the user's viewfrom being obstructed in a dangerous situation for the user to check thenotification content.

It should be understood that exemplary embodiments described hereinshould be considered in a descriptive sense only and not for purposes oflimitation. Descriptions of features or aspects within each exemplaryembodiment should typically be considered as available for other similarfeatures or aspects in other exemplary embodiments.

While one or more exemplary embodiments have been described withreference to the figures, it will be understood by those of ordinaryskill in the art that various changes in form and details may be madetherein without departing from the spirit and scope as defined by thefollowing claims.

What is claimed is:
 1. A wearable glasses comprising: a sensing circuitconfigured to sense movement information of a user wearing the wearableglasses; a communication circuit configured to receive notificationmessage information; a display configured to display the notificationmessage information within an angle of view of the user wearing thewearable glasses; and at least one memory configured to store one ormore programs; and one or more processors configured to execute the oneor more programs including instructions to: obtain environmentinformation including at least one of information about external soundsgenerated within a certain distance from the wearable glasses andinformation about an external image obtained by using an image sensor;determine a movement state of the user based on the sensed movementinformation of the user and the environment information; determine anoutput form for the received notification message as at least one of anaudio signal or a video signal based on the obtained environmentinformation; and control the wearable glasses to output the receivednotification message information in the determined output form accordingto the movement state of the user.
 2. The wearable glasses of claim 1,wherein the one or more processors are further configured to execute theone or more programs including instructions to determine whether theuser is wearing the wearable glasses by using at least one sensorincluded in the sensing circuit, and control the sensing circuit tosense a movement of the user when it is determined that the user iswearing the wearable glasses.
 3. The wearable glasses of claim 1,wherein the one or more processors are further configured to execute theone or more programs including instructions to determine the movementstate of the user by using at least one of acceleration information,tilt information, biometric information, altitude information,atmospheric pressure information, eyeball tracking information, andposition information measured by the sensing circuit.
 4. The wearableglasses of claim 1, wherein the one or more processors are furtherconfigured to execute the one or more programs including instructions todetermine the movement state of the user using movement information ofthe user received from an external device.
 5. The wearable glasses ofclaim 1, wherein the one or more processors are further configured toexecute the one or more programs including instructions to determine atime to display the notification message information based on themovement state of the user and control the display to display thenotification message information at the determined time.
 6. The wearableglasses of claim 5, wherein the one or more processors are furtherconfigured to execute the one or more programs including instructions tooutput the notification message information at a present time when amovement speed of the user is less than a threshold speed, and when themovement speed of the user is equal to or greater than the thresholdspeed, the one or more processors are further configured to execute theone or more programs including instructions to determine to output thenotification message information at a different time than the presenttime.
 7. The wearable glasses of claim 6, wherein the different timecomprises at least one of a point of time when a user input forrequesting to output the notification message information is received, apoint of time when the movement state of the user is changed, and apoint of time when a preset time has passed.
 8. The wearable glasses ofclaim 1, wherein the one or more processors are further configured toexecute the one or more programs including instructions to determine adisplay form for displaying the notification message information basedon the movement state of the user and control the display to display thenotification message information according to the determined displayform.
 9. The wearable glasses of claim 8, wherein when a movement speedof the user is equal to or greater than a threshold speed, the one ormore processors are further configured to execute the one or moreprograms including instructions to display a portion of the notificationmessage information, and when the movement speed of the user is lessthan the threshold speed, the one or more processors are furtherconfigured to execute the one or more programs including instructions todisplay an entirety of the notification message information.
 10. Thewearable glasses of claim 1, wherein the display is further configuredto display the notification message information in a form ofhighlighting a keyword in the notification message information orsetting a transparency of the notification message information.
 11. Thewearable glasses of claim 1, wherein the environment informationincludes the information about external sounds generated within acertain distance from the wearable glasses, and in response to theexternal sounds being greater than or equal to a threshold, determinethe output form as the video signal and control the display to displaythe received notification message information as the video signal, andin response to the external sounds being less than the threshold,determine the output form as the audio signal and control the wearableglasses to output the notification message as the audio signal.
 12. Thewearable glasses of claim 1, wherein the environment informationincludes the information about an external image obtained by using animage sensor, and wherein in response to edges in the obtained externalimage being greater than a threshold number, determine the output formas the audio signal and control the wearable glasses to output thereceived notification message as the audio signal, and in response tothe edges in the obtained external image being less than or equal to thethreshold number, determine the output form as the video signal andcontrol the wearable glasses to output the received notification messageas the video signal to the display.
 13. A method of providinginformation, wherein the method is performed by a wearable glasses andcomprises: receiving notification message information; sensing movementinformation of a user wearing the wearable glasses and obtainingenvironment information including at least one of information aboutexternal sounds generated within a certain distance from the wearableglasses and information about an external image obtained by using animage sensor; determining a movement state of the user based on thesensed movement information of the user and the environment information;determining an output form for the received notification message as atleast one of an audio signal or a video signal based on the obtainedenvironment information; and outputting the received notificationmessage information in the determined output form according to themovement state of the user.
 14. The method of claim 13, wherein thesensing of movement information of the user comprises: determiningwhether the user is wearing the wearable glasses by using at least onesensor included in the wearable glasses; and sensing the movementinformation of the user when it is determined that the user is wearingthe wearable glasses.
 15. The method of claim 13, wherein the displayingof the received notification message information comprises: determininga time to display the notification message information; and displayingthe notification message information at the determined time.
 16. Themethod of claim 15, wherein the determining the time to display thenotification message information comprises determining to output thenotification message information at a present time when a movement speedof the user is less than a threshold speed and to output thenotification message information at a different time than the presenttime when the movement speed of the user is equal to or greater than thethreshold speed.
 17. The method of claim 13, wherein the displaying ofthe received notification message information comprises: determining adisplay form for displaying the notification message information; anddisplaying the notification message information according to thedetermined display form.
 18. The method of claim 17, wherein thedetermining of the display form comprises: determining to output aportion of the notification message information when a movement speed ofthe user is equal to or greater than a threshold speed and to output anentirety of the notification message information when the movement speedof the user is less than the threshold speed.
 19. The method of claim13, wherein the displaying the received notification message informationaccording to the movement state of the user comprises: displaying thenotification message information in a form of highlighting a keyword inthe notification message information or setting a transparency of thenotification message information.